thumbor is an open-source photo thumbnail service by globo.com

Survey If you use thumbor, please take 1 minute and answer this survey? It's only 2 questions and one is multiple choice!!! thumbor is a smart imaging service. It enables on-demand crop, resizing and flipping of imag

Information

Category: Python / Image Processing
Watchers: 197
Star: 9k
Fork: 766
Last update: Jun 27, 2022

Resource links

http://thumbor.org

https://github.com/thumbor/thumbor

Survey

If you use thumbor, please take 1 minute and answer this survey? It's only 2 questions and one is multiple choice!!!

thumbor is a smart imaging service. It enables on-demand crop, resizing and flipping of images.

It also features a VERY smart detection of important points in the image for better cropping and resizing, using state-of-the-art face and feature detection algorithms (more on that in Detection Algorithms).

Using thumbor is very easy (after it is running). All you have to do is access it using an URL for an image, like this:

http://<thumbor-server>/300x200/smart/thumbor.readthedocs.io/en/latest/_images/logo-thumbor.png

That URL would show an image of the big brother brasil participants in 300x200 using smart crop.

There are several other options to the image URL configuration. You can check them in the Usage page.

For more information check thumbor's documentation.

Demo

You can see thumbor in action at http://thumborize.me/

Join the chat at https://gitter.im/thumbor/thumbor

18 Open More issues

Closed

Storage use tornado.concurrent.Future

Should fix #452

Two vows are currently failing due to some Async operation timing out after 5 seconds. Not sure why.

opened Mar 31, 2015 by masom 53

Closed

Upgrading from 6.4.1 to 6.5.X impacts response time and cpu usage

We have upgraded our docker image from thumbor 6.4.1 to 6.5.1 yesterday. Both CPU and response time are increasing considerably ever since, that's the only change that happened.

Expected behaviour

Nothing should dramatically change...

Actual behaviour

Both CPU usage and response-time went up considerably.

Orange - time to fetch
Blue - p95 of response time
Yellow dashed - Max response time
Red - deployment (first ones to upgrade, second one to downgrade)

Once I've downgraded back to 6.4.1 the response time went down again...

CPU Usage per pod after the deployments...

The spike matches the deployment time, the CPU usage went down over night because of the less intensive traffic but the response time was still higher (1.5x) the one before.

Operating system

Ubuntu 16.04 on K8s

Your thumbor.conf

    import re

    ALLOWED_SOURCES=[
      # https://regexper.com/https://regexper.com/#^https:\/\/*(.+)?hey[.]car\/*(.+)
      re.compile(r'^https://*(.+)?hey[.]car/*(.+)'),
    ]

    MAX_SOURCE_SIZE = 500
    SECURITY_KEY = "REDACTED"
    MAX_WIDTH = 2000
    MAX_HEIGHT = 2000

    # Cache
    MAX_AGE = 365 * 24 * 60 * 60
    MAX_AGE_TEMP_IMAGE = 240

    # Defaults
    QUALITY = 100

    # Engines
    HTTP_LOADER_CURL_ASYNC_HTTP_CLIENT = True

    # Metrics
    METRICS = "thumbor.metrics.statsd_metrics"
    STATSD_PORT = 8125
    STATSD_HOST = "datadog-statsd.kube-system"
    STATSD_PREFIX = "image_proxy_service"

    # GC Options
    GC_INTERVAL = 1800

    # AutoWebp
    AUTO_WEBP = True

    # Sentry
    ERROR_HANDLER_MODULE = "thumbor.error_handlers.sentry"
    SENTRY_DSN = "REDACTED"

Any thoughts on what could've caused this? Is there any new config that I need to take into account when upgrading? I've been reading the changelog and haven't found anything clearly related to that.

opened Jul 31, 2018 by marceloboeira 51

Closed

Memory Usage Explosion

We are experiencing memory usage explosion on Ubuntu 14.04.1 LTS with Thumbor v6.0.1 and Pillow 3.2.0. Our memory usage can hit ~97%. Then it will return to ~60% memory usage and after some time it will hit again ~97% memory usage.

After some investigation, there is possility that resize method in thumbor/engines/pil.py is the root cause. If we run gc.collect() in resize method, our memory usage is never hit 97% again.

Thumbor request URL

Sample url http://localhost:7001/unsafe/1920x1080/filename.jpg

Script to reproduce

#! /usr/bin/env ruby

require 'open-uri'

@total = 0
count = 100000

(5000..(5000+count)).each do |i|
  size = 2000 + rand(2000)
  wxh = [size, size].join('x')
  url = "http://localhost:7001/unsafe/#{wxh}/filename.jpg"
  start_time = Time.now
  open url
  end_time = Time.now
  duration = end_time - start_time
  @total += duration
  puts "got: #{url} in #{duration.round(2)}"
end

puts "That took: #{@total.round(2)} seconds"
puts "Average #{(@total / count).round(2)} per image"

Expected behaviour

Memory usage should below 90%

Actual behaviour

Memory usage hit ~97%

Operating system

14.04.1 LTS Thumbor v6.0.1 Pillow 3.2.0

thumbor.conf

MAX_AGE = 31536000
ALLOW_ANIMATED_GIFS = False
LOADER = 'thumbor.loaders.file_loader'

STORAGE = 'thumbor.storages.mixed_storage'
SECURITY_KEY = 'example'

ALLOW_UNSAFE_URL = True
FILE_LOADER_ROOT_PATH = '/vagrant/images'

REDIS_STORAGE_SERVER_HOST = 'example.com'
REDIS_STORAGE_SERVER_PORT = 6379
REDIS_STORAGE_SERVER_DB = 0
REDIS_STORAGE_SERVER_PASSWORD = None

MIXED_STORAGE_CRYPTO_STORAGE = 'tc_redis.storages.redis_storage'
MIXED_STORAGE_DETECTOR_STORAGE = 'tc_redis.storages.redis_storage'

DETECTORS = [
   'thumbor.detectors.face_detector',
   'thumbor.detectors.profile_detector',
   'thumbor.detectors.glasses_detector',
   'thumbor.detectors.feature_detector'
]

opened Jun 13, 2016 by kuntoaji 45

Closed

Support WebP

I was reading this article http://www.igvita.com/2012/12/18/deploying-new-image-formats-on-the-web/ and found myself thinking that it should be fairly easy for us to support webp format (supported currently by chrome and opera).

Do you guys think we should provide some flag that would make thumbor return the smallest possible image? The only downside is that browsers (as is said on the article) do NOT send proper Accept headers.

We could allow the users to specify what formats they want to support. Thumbor would generate the image in all the formats, then pick the smallest one.

What do you guys think?

opened Dec 19, 2012 by heynemann 43

Closed

Watermark : Enable watermark centering, refs issue #545

Allow the value 'center' to be passed to the filter's parameters x or/and y in order to automatically center the filigrane. ex : watermark(watermark.png,center,center,10) watermark(watermark.png,10,center,10) watermark(watermark.png,center,-10,10)

I don't know what I did wrong but the diff are not showing properly :

   regex = r'(?:watermark((?P<url>._?),(?P<x>-?[\d]_?),(?P<y>-?[\d]_?),(?P<alpha>[\d]_?)))'

   regex = r'(?:watermark\((?P<url>.*?),(?P<x>(?:-?\d+)|center),(?P<y>(?:-?\d+)|center),(?P<alpha>[\d]*?)\))'

```
   inv_x = self.x[0] == '-'       
```
```
   inv_y = self.y[0] == '-'  
```
```
   x, y = int(self.x), int(self.y)  
```
```
   center_x = self.x == 'center'
```
```
   center_y = self.y == 'center'
```
```
   if not center_x :
```
```
       inv_x = self.x[0] == '-'
```
```
       x = int(self.x)
```
```
   if not center_y :
```
```
       inv_y = self.y[0] == '-'
```
```
       y = int(self.y)
```
```
   if inv_x:
```

       x = (sz[0] - watermark_sz[0]) + x

```
   if inv_y:
```

       y = (sz[1] - watermark_sz[1]) + y

```
   if center_x :
```

       x = (sz[0] - watermark_sz[0]) /2

```
   elif inv_x:
```

       x = (sz[0] - watermark_sz[0]) + x

```
   if center_y :
```

       y = (sz[1] - watermark_sz[1]) /2

```
   elif inv_y:
```

       y = (sz[1] - watermark_sz[1]) + y

@filter_method(BaseFilter.String, r'-?[\d]+', r'-?[\d]+', BaseFilter.PositiveNumber, async=True)
@filter_method(BaseFilter.String, r'(?:-?\d+)|center', r'(?:-?\d+)|center', BaseFilter.PositiveNumber, async=True)

opened Sep 17, 2015 by adeboisanger 38

Closed

using trim with certain transparent png's results in not-transparent images

Original:

With trim (wrong / no transparency):

Without trim (transparency = good):

I had the idea maybe this could be the problem: https://github.com/thumbor/thumbor/blob/master/thumbor/transformer.py#L96

opened Jul 29, 2015 by LeonB 35

Open

Update libraries.rst

beeyev/thumbor-php library added

opened Jun 26, 2022 by beeyev 1

Open

added new validation in watermark filter to respect allowed sources configuration

It was add a new validation and now watermarks filters respects allowed sources configuration, fixing https://github.com/thumbor/thumbor/issues/1455

opened Jun 20, 2022 by maiagripp 1

Open

Filling image with background color and using nested watermark

Thumbor request URL

I am trying to fill color to tint the gradient image and watermark my colored gradient image on the black background image.

http://localhost:8888/unsafe/full-fit-in/480x540/ http://localhost:8888/unsafe/960x540/filters:watermark(image_1,0,0,50):watermark(image_2,480,0,60)/blackbackground.png I want to fill red background for my image_1 and blue in my image_2. Is it possible inside the watermark to apply background color? Is it possible to add a watermark inside the watermark?

Expected behaviour

Tell us what should happen I should get image with red and blue background

Actual behaviour

Tell us what happens instead background-color disappers

Operating system

OSx, Ubuntu, etc osx

Your thumbor.conf

Your config file (WARNING: replace your SECURITY_KEY key with a dummy key or your key will become public)

opened Jun 16, 2022 by ajaypande88 3

Open

Watermark url is not subject to ALLOWED_SOURCES

Thumbor request URL

http://localhost:8888/unsafe/filters:watermark(http://domain2/foo,0,0,0)/http://domain1/bar

Expected behaviour

Watermark request should respect ALLOWED_SOURCES.

Actual behaviour

Arbitrary URL can be supplied and will be fetched.

Operating system

Ubuntu

Your thumbor.conf

ALLOWED_SOURCES = ['domain1']

BUG

opened Jun 16, 2022 by FelixMartel 1

Open

Thumbor being killed by cairosvg loading too big svg file.

Thumbor request URL

host:port/unsafe/200x0/https://svgshare.com/i/i5q.svg

Expected behaviour

Thumbor already validate Decompression Bomb Attacks pil.py but engine.__init__.py was not validating before loads svg, and when Thumbor calls cairosvg.svg2png the main process was being killed.

If I call cairosvg inside my Docker container, I receive only a message Killed with exit code 137

$ cairosvg -f png /tmp/bomb.svg
Killed
$ echo $?
137

Thumbor log:

2022-06-06 22:37:01 thumbor:DEBUG METRICS: timing: original_image.fetch.200.svgshare_com:667
2022-06-06 22:37:01 thumbor:DEBUG METRICS: inc: original_image.fetch.200.svgshare_com:1
2022-06-06 22:37:01 thumbor:DEBUG METRICS: inc: original_image.status.200:1
2022-06-06 22:37:01 thumbor:DEBUG METRICS: inc: original_image.status.200.svgshare_com:1
2022-06-06 22:37:01 thumbor:DEBUG METRICS: inc: original_image.response_bytes:10228

make: *** [Makefile:7: run] Killed

svg used

Actual behaviour

Thumbor could validate with MAX_PIXELS like pil.py does, before call cairosvg.svg2png

Looking for ways to validate svg size, maybe this could help:

from cairosvg.parser import Tree

width = Tree(bytestring=buffer).get("width")
height = Tree(bytestring=buffer).get("height")

max_size = width * height
max_size > context.config.MAX_PIXELS

Operating system

We are currently running Thumbor inside a docker debian with 512Mb RAM, and python version 3.9.

cd thumbor/

docker build --platform linux/amd64 -f TestDockerfile39 -t thumbor-test-39 .

docker run --rm -it --name thumbor-test --memory 512mb -p 8888:8888 --platform linux/amd64 -v "$(pwd):/app" thumbor-test-39 make setup run

docker cp bomb.svg thumbor-test:/tmp/bomb.svg
docker exec -it thumbor-test bash

# inside container
cairosvg -f png /tmp/bomb.svg

or call Thumbor

curl localhost:8888/unsafe/200x0/https://svgshare.com/i/i5q.svg

Your thumbor.conf

Default from thumbor/thumbor.conf

opened Jun 6, 2022 by RaphaelVRossi 0

Open

Fix library test example in docs and use python3

The signing code has moved in thumbor and it no longer supports Python 2

% python3 -c 'from thumbor.crypto import Signer; signer = Signer("secret"); print(signer.signature("url"))'
Traceback (most recent call last):
  File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'thumbor.crypto'

% python3 -c 'from libthumbor.url_signers.base64_hmac_sha1 import UrlSigner; signer = UrlSigner("secret"); print(signer.signature("url").decode("utf-8"))'
jjTzhyRdkQ3WHRCJofpLTjuYCZI=

opened May 30, 2022 by tchollingsworth 2

7.0.10(May 20, 2022)

What's Changed

Remove snapshottest to reduce number of dependencies by @scorphus in https://github.com/thumbor/thumbor/pull/1433
Apply filters in the same order as in the URI by @scorphus in https://github.com/thumbor/thumbor/pull/1435
py3exiv2 0.11.0 breaks python3.10 unit test by @RaphaelVRossi in https://github.com/thumbor/thumbor/pull/1436
Skip test from #1435 for python3.7 version by @RaphaelVRossi in https://github.com/thumbor/thumbor/pull/1438

Full Changelog: https://github.com/thumbor/thumbor/compare/7.0.9...7.0.10

Source code(tar.gz)
Source code(zip)

7.0.9(May 1, 2022)

ATTENTION

In case your deployment/delivery pipelines do not rely on setup.py to install the set of dependencies, be aware that colorful has been replaced by colorama.

What's Changed

ext/filters/_convolution: Apply convolution to alpha channel too by @scorphus in https://github.com/thumbor/thumbor/pull/1411
Include WebP files in MANIFEST.in by @marcelometal in https://github.com/thumbor/thumbor/pull/1426
Remove socketfromfd dependency to be able to launch thumbor with the --fd option by @ebilheude in https://github.com/thumbor/thumbor/pull/1422
Replace 'colorful' with 'colorama' by @marcelometal in https://github.com/thumbor/thumbor/pull/1427
Added pre-commit by @marcelometal in https://github.com/thumbor/thumbor/pull/1394
Improving URL composer by @marcelometal in https://github.com/thumbor/thumbor/pull/1430

New Contributors

@ebilheude made their first contribution in https://github.com/thumbor/thumbor/pull/1422

Full Changelog: https://github.com/thumbor/thumbor/compare/7.0.8...7.0.9 PyPi release: https://pypi.org/project/thumbor/7.0.9/

Source code(tar.gz)
Source code(zip)

7.0.8(Apr 2, 2022)

WARNING

If you are using thumbor's gifv optimizer, please switch to use thumbor-plugins gifv optimizer instead. We will discontinue this plugin from thumbor's main codebase soon!

Using it is pretty simple. Make sure you have installed it with pip install thumbor-plugins-gifv and then in your thumbor.conf:

OPTIMIZERS = [
    'thumbor_plugins.optimizers.gifv',
]

What's Changed

Add black formatter by @guilhermef in https://github.com/thumbor/thumbor/pull/1428
Fixed thumbor-url by @marcelometal in https://github.com/thumbor/thumbor/pull/1409
Moving gifv to thumbor-plugins by @guilhermef in https://github.com/thumbor/thumbor/pull/1423
Fixed issue #1417 with invalid usage of the same metric naming for two different metrics @heynemann

Full Changelog: https://github.com/thumbor/thumbor/compare/7.0.7...7.0.8 PyPi release: https://pypi.org/project/thumbor/7.0.8/

Source code(tar.gz)
Source code(zip)

7.0.7(Mar 16, 2022)

What's Changed

README Improvements by @heynemann
CONTRIBUTING Improvements by @nicolasgabrielt and @marcelometal in #1402
Fix convolution filter by @RaphaelVRossi in #1419
Fix saturation filter by @devppjr in #1421
DOCS Improvements by @Chavao in #1415 and #1416
Fix TypeError in sentry error handler by @OndrejIT in #1420
Build test image on Github action by @guilhermef in #1414

Full Changelog: https://github.com/thumbor/thumbor/compare/7.0.6...7.0.7 PyPi release: https://pypi.org/project/thumbor/7.0.7/

Source code(tar.gz)
Source code(zip)

7.0.6(Jan 27, 2022)

Potential Breaking Change

This should've been a major, but it should not cause major issues. If your thumbor install depends on OpenCV, instead of installing thumbor with pip install thumbor use pip install thumbor[all] and opencv-python-headless will be installed with it. Otherwise, if you already have OpenCV installed, no issues.

To make sure everything is smooth, just run thumbor-doctor -c <your thumbor.conf file> and thumbor will verify it can import OpenCV (if you are using it in some way).

What's Changed

Feature/optional opencv by @heynemann in https://github.com/thumbor/thumbor/pull/1400
README Improvements by @heynemann in https://github.com/thumbor/thumbor/pull/1401

Full Changelog: https://github.com/thumbor/thumbor/compare/7.0.5...7.0.6 PyPi release: https://pypi.org/project/thumbor/7.0.6/

Source code(tar.gz)
Source code(zip)

7.0.5(Jan 26, 2022)

What's Changed

Remove mock library dependency by @jairhenrique in https://github.com/thumbor/thumbor/pull/1396
Allowed sources work in file_loader_http_fallback by @heynemann in https://github.com/thumbor/thumbor/pull/1399
Fixed mock import by @marcelometal in https://github.com/thumbor/thumbor/pull/1398
doctor: fix errors when there is no config by @marcelometal in https://github.com/thumbor/thumbor/pull/1397

New Contributors

@jairhenrique made their first contribution in https://github.com/thumbor/thumbor/pull/1396

Full Changelog: https://github.com/thumbor/thumbor/compare/7.0.3...7.0.5 PyPi Release: https://pypi.org/project/thumbor/7.0.5/

Source code(tar.gz)
Source code(zip)

Phimp.me - Photo Image Editor and Sharing App. Phimp.me is a Photo App for iOS that aims to replace proprietary photo applications. It offers features such as taking photos, adding filters, editing images and uploading them to social networks.

This is a new web-based photo management application. Run it on your home server and it will let you find the right photo from your collection on any device. Smart filtering is made possible by object recognition, location awareness, color analysis and other ML algorithms.

A Tensorflow implementation of AnimeGAN for fast photo animation ! This is the Open source of the paper <AnimeGAN: a novel lightweight GAN for photo animation>, which uses the GAN framwork to transform real-world photos into anime images.

A simple easy to use library that lets you edit pictures on the fly with easy. Photo filter lets you apply a large number of filters all while maintaining maximum image quality. Supports Android 2.3 and higher.

Fast, simple, configurable photo portfolio website generator

A full image reveal effect with fancy thumbnail sliding.

Thumbnailator - a thumbnail generation library for Java

PHP library allowing thumbnail, snapshot or PDF generation from a url or a html page. Wrapper for wkhtmltopdf/wkhtmltoimage

This little program generates a thumbnail of a certain pdf for quick visualization. It is based on ImageMagick as it has all the functionality required.

:muscle: A Kirby field to enable file thumbnail preview in the panel sidebar

A thumbnail view for iOS to give context to multiple images/videos using thumbnails and counter.

A set of link hover effects that reveal a thumbnail in different creative ways.

An Android video thumbnail picker

A draggable menu that shows a thumbnail preview of an image grid

An experimental animation where an image goes from thumbnail to full width, allowing for a classy entry to an article view.

Get the animated thumbnail URL of a Youtube video

This is Pdisk Upload Bot made using Python with Pyrogram Framework. Its capable of uploading direct download link with thumbnail or without thumbnail & with Title Support.

Music Thumbnail Maker

An Inline Telegram bot that can download YouTube videos with permanent thumbnail support

Phimp.me Photo Imaging and Picture Editor https://play.google.com/store/apps/details?id=org.fossasia.phimpme

A standalone service center to allow services to register their instance information and to discover providers of a given service

Share this repo

Related Repos

Image Processing

Fast Image Retrieval (FIRe) is an open source image retrieval project release by Center of...

Fast Image Retrieval Documentation: https://fast-image-retrieval.readthedocs.io/en/latest/ Introduction Fast Image Retrieval (FIRe) is an open source

Image Processing

100

A python script developed to process Windows memory images based on triage type.

Overview A python script developed to process Windows memory images based on triage type. Requirements Python3 Bulk Extractor Volatility2 with Communi

Image Processing

fishington.io bot with OpenCV and NumPy

fishington.io-bot fishington.io bot with using OpenCV and NumPy bot can continue to fishing fully automatically how to use Open cmd in fishington.io-b

Image Processing

380

Pixray is an neural image generation system

Image Processing

1.3k

BackgroundRemover lets you Remove Background from images and video with a simple command l...

BackgroundRemover lets you Remove Background from images and video with a simple command line interface

Image Processing

A fast python implementation of Ray Tracing in One Weekend using python and Taichi

A fast python implementation of Ray Tracing in One Weekend using python and Taichi.

Image Processing

331

cmdpxl: a totally practical command-line image editor

Image Processing

2.8k

🎇 Quickly search over billions of images

image-match is a simple (now Python 3!) package for finding approximate image matches from a corpus. It is similar, for instance, to pHash, but includes a database backend that easily scales to billions of images and supports sustained high rates of image insertion: up to 10,000 images/s on our cluster!

Image Processing

115

WaterDetect is an end-to-end algorithm to generate open water cover mask, specially concei...

WaterDetect is an end-to-end algorithm to generate open water cover mask, specially conceived for L2A Sentinel 2 imagery from MAJA1 processor, without any a priori knowledge on the scene. It can also be used for Landsat 8 images and for other multispectral clustering/segmentation tasks.

Image Processing

157

PIX is an image processing library in JAX, for JAX.

JAX is a library resulting from the union of Autograd and XLA for high-performance machine learning research. It provides NumPy, SciPy, automatic differentiation and first-class GPU/TPU support.

Image Processing

The first dataset of composite images with rationality score indicating whether the object...

Object-Placement-Assessment (OPA) is to verify whether a composite image is plausible in terms of the object placement. The foreground object should be placed at a reasonable location on the background considering location, size, occlusion, semantics, and etc.

Image Processing

Object Shadow Generation is to deal with the shadow inconsistency between the foreground o...

Object Shadow Generation is to deal with the shadow inconsistency between the foreground object and the background in a composite image, that is, generating shadow for the foreground object according to background information, to make the composite image more realistic.

Image Processing

Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text an...

Source code for models described in the paper "AudioCLIP: Extending CLIP to Image, Text and Audio"

Image Processing

This is an example of a fur shader implementation in Universal Render Pipleine

Image Processing

Some codes from PyImageSearch course's and external projects.