
Read the full blog entry here.
2019-12-17 14:36:18
2019-12-17 15:50:15
I think that Blade Runner beat them to it by a decade or two. There's also a film where the protagonist's face is on an unclear photograph from a murder scene. The image is being 'enhanced'. He only has a few hours of freedom to clear his name before the program completes and makes him the prime suspect. I wish I could remember the film.like they do in all those cheesy police dramas
2019-12-17 16:11:37
2019-12-17 18:56:25
2019-12-17 19:43:28
2019-12-17 20:43:34
No Way Out. Kevin Costner, Sean Young.2019-12-17 15:50:15 I think that Blade Runner beat them to it by a decade or two. There's also a film where the protagonist's face is on an unclear photograph from a murder scene. The image is being 'enhanced'. He only has a few hours of freedom to clear his name before the program completes and makes him the prime suspect. I wish I could remember the film.
I'm looking forward to using this... but for more mundane purposes, though.
2019-12-17 21:16:35
Now... the question is... should I
2019-12-17 21:45:05
So the update is still not appearing on the Mac App Store — we've reported this to the App Store team and we hope it'll be fixed ASAP. In the meantime, we've released a beta version of Pixelmator Pro with these features and a few more goodies. If you're on the beta program, you can simply get the update through the app. And if you're not, you can sign up for the beta here.
2019-12-18 11:23:18
2019-12-18 12:05:17
Without seeing examples of the types of images you're upscaling, it's difficult to say what could be going wrong. The examples on our blog are all 100% real but it's also important to note that, at least for now, the algorithm cannot introduce details that aren't already in the image. It's really good at recognizing small details and upscaling them realistically (unlike the classic algorithms) but the data does have to be in the image. Also, the algorithm isn't designed to sharpen blurry images that have already been upscaled using one of the traditional algorithms. In situations like that, it might be best to first downscale the image, then use ML Super Resolution to upscale it.2019-12-18 08:25:57 I installed the update on my Macbook Pro 13 inch (early 2015) and just like the ML Denoise feature that you introduced a couple of versions earlier, the ML Super Resolution filter does not work on my mac. It takes about 3 minutes for every picture to process and the result is not the same as nothing but very close to nothing. It changes how some pixels look but even with the sample images you provide i cannot get any real sharpening that is close to your examples. The ML Denoise feature also does not do much. Is there any setting i have to change? In your explanations it seemed like all macs that support Metal can do the processing albeit needing more time for it but in the end the effect should still be the same.
2019-12-18 19:25:13
2019-12-18 19:53:02
2019-12-18 20:41:53
2019-12-18 21:38:45
2019-12-18 21:40:39
It's an other entry in the Image menu: use ML Super Resolution instead of Resize2019-12-19 01:53:02 Just downloaded the trail version (1.5.5) and am running it on a 5kRetina iMac under High Sierra. When I went to the Image Size window to try your new resizing option, it did not show up. Only the older methods - Lanczos, Nearest Neighbor, etc. -- were there.
Does this new resizing method depend on the newer OS, or some hardware my iMac doesn't have?
Thanks
2019-12-18 22:07:47
2019-12-18 23:13:16
2019-12-19 00:25:15
2019-12-19 08:10:37
I thought about the print one, too. I haven’t thought about the crop one. That is really huge. Thanks for mention that.Can’t wait to try it out! And just so this is clear to everyone, it is not designed to make your image sharper, but it is supposed to keep the image quality the same when enlarging am image. Photos normally degrade when enlarged. If you don’t need a large photo, there is no need to use this feature. I see it being fantastic for large prints or if quite a bit of cropping needs to be done on a photo.
2019-12-19 08:59:58
Yes, and it's optimized for Core ML 3 to take advantage of multi-GPU support, making this feature much faster on devices with a dedicated GPU.
This feature is very memory-intensive so it may not be possible to bring it to iPadOS due to the differences in memory management, but we'll most certainly try.
It requires macOS Mojave or macOS Catalina, so it won't work on High Sierra — apologies for not making that clearer!Just downloaded the trail version (1.5.5) and am running it on a 5kRetina iMac under High Sierra. When I went to the Image Size window to try your new resizing option, it did not show up. Only the older methods - Lanczos, Nearest Neighbor, etc. -- were there.
Does this new resizing method depend on the newer OS, or some hardware my iMac doesn't have?
Thanks
The print size of the image shouldn't change, only the resolution/pixel dimensions should — when using the ML Super Resolution menu command at least. You could also open up Image > Image Size and enter a custom size/resolution, choosing the ML Super Resolution algorithm for resizing.Do I understand the super resolution tool?
I have an image. 46,33x30,69 centimetres.
I change the image size to 21cmx14cm.
The resolution is now 118,11.
I choose ML Super resolution and change the resolution from 118,11 to 300.
The image size for some reason changes to 41,99x28cm.
I change it back to the size I want, 21x14.
Is this the way I should work?
If I am impressed?
I don't know yet. Will have to practise.
It would! We might be able to do this, actually.
Yes, that's a very good point! Also, it won't do much to images that have already been enlarged and are blocky or blurry because the algorithm will interpret the blocks or blurred edges as textures. You could try downscaling the image first and then upscaling using ML Super Resolution.2019-12-18 23:13:16 Can’t wait to try it out! And just so this is clear to everyone, it is not designed to make your image sharper, but it is supposed to keep the image quality the same when enlarging am image. Photos normally degrade when enlarged. If you don’t need a large photo, there is no need to use this feature. I see it being fantastic for large prints or if quite a bit of cropping needs to be done on a photo.
You're absolutely right, fixed!
I really hate spoiling surprises but, seeing as you're asking:2019-12-19 05:23:08 @ Andrius, great to see features which where just recently possible through the OS innovation. Amazing surprise! That is showing that the heart of the app has Mac DNA.![]()
1. Before Pixelmator Pro 2.0 comes out, do you guys address requested features like adjustment layers, multiple colour replace possibilities, new colour picker and releasing the clarity ML and Denoise ML with sliders to work with? Thanks.
2019-12-19 14:59:18
Are you still developers or already data scientists? Good job on ML Super Resolution. From bioinformatician.2019-12-17 14:36:18 It’s no secret that we’re pretty big fans of machine learning and we love thinking of new and exciting ways to use it in Pixelmator Pro. Our latest ML-powered feature is called ML Super Resolution, released in today’s update, and it makes it possible to increase the resolution of images while keeping them stunningly sharp and detailed. Yes, zooming and enhancing images like they do in all those cheesy police dramas is now a reality!
Read the full blog entry here.
2019-12-19 15:33:18
You may consider collaborating with professional scientists in ML field. I know medical biologists working with image analysis. Communicating with them may result in scientific publications which will add credibility to your apps and may be useful to them too.
2019-12-19 21:07:48
2019-12-19 22:55:14
2019-12-20 08:59:22
Yes, and it's optimized for Core ML 3 to take advantage of multi-GPU support, making this feature much faster on devices with a dedicated GPU.
This feature is very memory-intensive so it may not be possible to bring it to iPadOS due to the differences in memory management, but we'll most certainly try.
It requires macOS Mojave or macOS Catalina, so it won't work on High Sierra — apologies for not making that clearer!
The print size of the image shouldn't change, only the resolution/pixel dimensions should — when using the ML Super Resolution menu command at least. You could also open up Image > Image Size and enter a custom size/resolution, choosing the ML Super Resolution algorithm for resizing.
It would! We might be able to do this, actually.
Yes, that's a very good point! Also, it won't do much to images that have already been enlarged and are blocky or blurry because the algorithm will interpret the blocks or blurred edges as textures. You could try downscaling the image first and then upscaling using ML Super Resolution.
You're absolutely right, fixed!
I really hate spoiling surprises but, seeing as you're asking:
1. Adjustment layers — maybe in the second half of next year? We need to finish up the color adjustment feature set first and a few foundational changes need to be made to bring the Clarity adjustment as well as improved shadows and highlights.
2. Replacing multiple colors — this is a UI thing as this feature could already work this way from a technological standpoint. And we'd also need to add it to Pixelmator Photo due to the shared codebase. But thanks for the reminder.
3. Color picker — in development at the moment but it doesn't look like it'll come before the new year. It's going to be really cool, though, so it's worth the wait.
4. ML Denoise — the 1.5.4 update brought some improvements to ML Denoise, and 1.5.5 will bring even more. The results should be much more dramatic after these updates (especially in images with heavy noise) but a slider won't appear just yet.
2019-12-20 10:04:57
If the goal of the algorithm was to synthesize missing details, we'd have to use a completely different approach — rather than a convolutional neural network, it would have to be a generative adversarial network. The problem with that is that it would synthesize details from noise and would generally be much more unpredictable, so it wouldn't have as much of a functional use. We decided to go for predictability and consistency.
This would also require a different approach to the one we've chosen, specifically to take multiple frames into account to keep the colors/brightness consistent between frames. But it would definitely be cool!Also, have you considered using this to upscale old videos to better resolution? Not a feature for Pixelmator, unless you just want to extract a better-resolution image of a single frame (maybe also using some inter-frame info?). But perhaps a cool new product.
No wavelet-based reconstruction techniques, most of what we did is mentioned in the blog. That Let's Enhance video is awesome, by the way!2019-12-19 22:55:14 This is amazing! I am curious if you also incorporated wavelet-based reconstruction techniques along with the machine learning?
And I wanted to bring your attention to "Let's Enhance": https://www.youtube.com/watch?v=Vxq9yj2pVWk
Thanks!
2019-12-22 09:46:28
2019-12-24 05:16:05
2019-12-27 11:14:24
ML Super Resolution is designed for upscaling images only — for downsampling, you're best off using one of the other algorithms.2019-12-22 09:46:28 I have seen that ml resolution is also available in the image resize level. Does it downscale with a bigger file size then the other algorithms to keep the quality high or is the size the same but still better quality? In other words world you use it as default to resize an image? Of course, I could test it but if it does, would like to know when I should use it. Thanks
Super-resolution is actually just the standard term used for any action that creates a higher-resolution image from a low-res one. This can also be done by merging multiple pixel-shifted exposures, for example, so you might also see the term there.
We're looking forward to the coming years too! And we're especially looking forward to the improvements we have lined up for the next few months.
2019-12-27 11:17:42
I am so excited to see you guys are not slowing down and your flagship product is going to be better and better...2019-12-27 11:15:31
ML Super Resolution is designed for upscaling images only — for downsampling, you're best off using one of the other algorithms.
Super-resolution is actually just the standard term used for any action that creates a higher-resolution image from a low-res one. This can also be done by merging multiple pixel-shifted exposures, for example, so you might also see the term there.
We're looking forward to the coming years too! And we're especially looking forward to the improvements we have lined up for the next few months.
2020-01-02 14:41:17
2020-01-02 15:12:44