Skip to content

midorinet/ngx_small_light

Repository files navigation

ngx_small_light

A dynamic image transformation module for nginx.

Table of contents

Features

Supports the various image-processings below.

  • Resize
  • Rotate
  • Sharpen
  • Unsharpen
  • Blur
  • Border
  • Canvas
  • Crop
  • Composition
  • JPEG Hinting(except GD)
  • Format convert(e.g. PNG -> JPEG)
  • Color-space convert(e.g. CMYK -> sRGB)

ngx_small_light is developed for using as the same way as mod_small_light as possible in nginx.

Supported Formats

Supports the formats below.

  • JPEG
  • GIF(except Imlib2)
  • PNG
  • WebP(except Imlib2)

Dependencies

Installation

For more detailed installation instructions (including building all dependencies), please see the Full Guide Installation section.

cd ${ngx_small_light_src_dir}
./setup
cd {$nginx_src_dir}
./configure --add-module=${ngx_small_light_src_dir}
make
make install

If you want to enable the libraries except ImageMagick in ngx_small_light, add the options below when executing setup. (ImageMagick is always enabled)

./setup                         # enable ImageMagick
./setup --with-imlib2           # enable ImageMagick and Imlib2
./setup --with-gd               # enable ImageMagick and GD
./setup --with-imlib2 --with-gd # enable ImageMagick and Imlib2 and GD

Dynamic module

You can also compile ngx_small_light as the dynamic module with --add-dynamic-module in nginx-1.9.11 and ngx_small_light-0.6.15 or later.

cd ${ngx_small_light_src_dir}
./setup
cd {$nginx_src_dir}
./configure \
--modules-path=/usr/local/nginx/modules \
--add-dynamic-module=${ngx_small_light_src_dir}
make
make install

Add the configuration below for loading module dynamically.

load_module /usr/local/nginx/modules/ngx_http_small_light_module.so;

Getting started

Add the configuration below to some server context in nginx.conf and start nginx.

small_light on;
location ~ small_light[^/]*/(.+)$ {
    set $file $1;
    rewrite ^ /$file;
}

If you can get the original image of image.jpg from the URL below,

http://$host:$port/img/image.jpg

You will be able to get the converted image of image.jpg from the URL below.

http://$host:$port/small_light(dw=300,dh=300)/img/image.jpg

The part of small_light(...) is called small_light function.

Configuration example

There is some configuration example below.

server {
    listen 8000;
    server_name localhost;

    small_light on;
    small_light_pattern_define msize dw=500,dh=500,da=l,q=95,e=imagemagick,jpeghint=y;
    small_light_pattern_define ssize dw=120,dh=120,da=l,q=95,e=imlib2,jpeghint=y;

    # http://localhost:8000/small_light(p=msize)/img/filename.jpg -> generate msize image
    # http://localhost:8000/small_light(p=ssize)/img/filename.jpg -> generate ssize image
    # http://localhost:8000/small_light(of=gif,q=100)/img/filename.jpg -> generate gif image which quality is 100
    location ~ small_light[^/]*/(.+)$ {
        set $file $1;
        rewrite ^ /$file;
    }
} 

Directives

small_light

Syntax small_light on | off
Default off
Context server, location

This directive sets whether image-processing with ngx_small_light is enabled in a server context.

small_light_getparam_mode

Syntax small_light_getparam_mode on | off
Default off
Context server, location

This directive sets whether converting-image is enabled by GET parameters instead of small_light function (e.g. /small_light(dw=200,dh=200)). At the expense of it, a small_light function is disabled. But you need to set both small_light and small_light_getparam_mode on to enable the feature of this directive.

small_light_material_dir

Syntax small_light_material_dir path
Default
Context server

This directive assigns the directory for embedded icon images.

small_light_pattern_define

Syntax small_light_pattern_define pattern_name parameters
Default
Context server

This directive names comma-delimited parameters.

small_light_radius_max

Syntax small_light_radius_max number
Default 10
Context server,location

This directive sets maximum radius value of geometry for sharpen and unsharp and blur.

small_light_sigma_max

Syntax small_light_sigma_max number
Default 10
Context server,location

This directive sets maximum sigma value of geometry for sharpen and unsharp and blur.

small_light_imlib2_temp_dir

Syntax small_light_imlib2_temp_dir path [level1 [level2 [level 3 ]]]
Default small_light_imlib2_temp 1 2
Context server

This directive assigns the directory for temporary file for Imlib2 processing. This directive is available when Imlib2 is enabled.

small_light_buffer

Syntax small_light_buffer size
Default 1m
Context server

This directive assigns the maximum size of the buffer used for reading images when Content-Length is not set in response headers.

Parameters for small_light function

Parameter Type Default Description ImageMagick Imlib2 GD
p string named pattern of comma-delimited parameters
e string imagemagick engine name (imagemagick, imlib2, gd)
q number quality
of string output format (jpg, gif, png, webp)
jpeghint char n enable jpeg hinting (y, n)
dw coord sw destination width
dh coord sh destination height
dx coord sx destination x coordinate
dy coord sy destination y coordinate
da char l destination aspect ratio contol (l, s, n)
ds char n destination scaling control (s, n)
cw number canvas width
ch number canvas height
cc color 000000 canvas color
bw number border width
bh number border height
bc color 000000 border color
sw coord source witdh
sh coord source height
sx coord source x coordinate
sy coord source y coordinate
pt char n pass through control (y, n)
sharpen string radius,sigma (e.g. 10x5)
unsharp string radius,sigma,amount,threshold (e.g 2x5+0.5+0)
blur string radius,sigma (e.g. 5x10)
bluroptimize char n optimize blur (y, n)
embedicon string embedded icon file in small_light_material_dir
ix number 0 embedded icon x coordinate
iy number 0 embedded icon y coordinate
angle number 0 angle of rotation (90, 180, 270)
progressive char n make JPEG progressive (y, n)
cmyk2rgb char n convert colorspace from CMYK to sRGB (y, n)
rmprof char n remove profile (y, n)
autoorient char n enable adjust image orientation automatically (y, n)

The values of da are l and s and n. These present the meanings below.

  • l: long-edge based
  • s: short-edge based
  • n: nope

There are any limitations below.

  • of=gif and of=webp are not supported when e=imlib2.
  • autoorient is available ImageMagick-6.9.0 or later.
  • The value of radius,sigma for sharpen and unsharp and blur is limited by small_light_radius_max and small_light_sigma_max.

There are the types of each parameter below.

Type Description
coord coordicante or pixel. percent when appending 'p'
char character
number integer number
color rrggbb or rrggbbaa
string string

Named Pattern

ngx_small_light supports to name comma-delimited parameters with the small_light_define_patern.

small_light_pattern_define small dw=120,dh=120,q=80,e=imagemagick,jpeghint=y;

If the line above is added to some server context in nginx.conf, the two URLs below return same response.

  • http://$host:$port/small_light(p=small)/img/image.jpg
  • http://$host:$port/small_light(dw=120,dh=120,q=80,e=imagemagick,jpeghint=y)/img/image.jpg

Using GET parameters

ngx_small_light supports to convert image not only by small_light function but by GET paramenters in v0.5.0 or later. You need to set both small_light and small_light_getparam_mode on to enable this feature. At the expense of enabling this feature, small_light function (e.g. /small_light(dw=300,dh=300)/img.jpg is disabled.

small_light on;
small_light_getparam_mode on;

In the configuration above, the url below does not return converted image.

http://localhost:8000/small_light(dw=200,dh=200)/img/image.jpg

Instead the url below returns converted image expected by right.

http://localhost:8000/img/image.jpg?dw=200&dh=200

Enabling WebP Transformation

ngx_small_light supports WebP transformation with ImageMagick and GD. Given of=webp to small_light function, ngx_small_light transforms image format into WebP. But ImageMagick requires libwebp and GD requires libvpx. You need to embed these libraries in building ImageMagick and GD for enabling WebP transformation.

If WebP transformation is not available, nginx outputs the line like below in error.log in processing image with of=webp.

WebP is not supported

If WebP transformation with ImageMagick is available, the output of convert -list format includes the line like below.

$ convert -list format | grep -i webp
     WEBP* WEBP      rw-   WebP Image Format (libwebp 0.5.0[0208])

If WebP transformation with GD is available, the output of gdlib-config --libs includes -lvpx.

In general, the packages of ImageMagick and GD provided from the linux distributions such as Ubuntu and CentOS does not embed the library for WebP transformation by default. In such cases, you need to build ImageMagick or GD yourself.

Optimizing Tips

There are some optimizing tips for ngx_small_light.

JPEG hinting

When the output format is JPEG and image-converting engine is ImageMagick or Imlib2, you may give jpeghint=y. The speed of processing images is improved dramatically.

Limit thread-number with OpenMP

When image-converting engine is ImageMagick and the version of ngx_small_light is lower than v0.6.14, giving 1 to OMP_NUM_THREADS or MAGICK_THREAD_LIMIT in nginx.conf is recommended strongly. Because OpenMP is enabled in ImageMagick by default and ImageMagick enabled OpenMP is very slow on multi-process environment.

env OMP_NUM_THREADS=1; # or env MAGICK_THREAD_LIMIT=1;

Or you can avoid this problem by building ImageMagick with --disable-openmp.

In v0.6.14 or later, they are no longer required. Because ngx_small_light always sets the thread-number with OpenMP 1.

Limitations

ngx_small_light has the limitations below.

Not supported features with Imlib2

The transformation with Imlib2 does not support to write GIF-image. Because Imlib2 has the function for loading GIF-image but does not have the function for saving. Additionally, the transformation by Imlib2 does not support to write and read WebP-image. So of=gif and e=imlib2 are not enabled to specify at once. If these are specified, ngx_small_light returns 415(Unsupported Media Type).

Not supported features with GD

The transformation with GD supports to write WebP-image. But it is the experimental feature.

Not supported animated GIF

ngx_small_light does not support the transformation kept animation for animated GIF. Because it takes long time to transform(e.g. resize, crop) animated GIF kept animation. So it is not realistic for ngx_small_light to support an animated GIF.

If the animated GIF is given, ngx_small_light transforms only the first frame.

Running Tests

  1. Run this command for the first time to install the dependencies.
    sudo cpan Module::Build
  2. Then run this command to build test modules.
    perl Build.PL
  3. For the first time, run this command to install the dependencies.
    sudo ./Build installdeps
    ./Build manifest
  4. Run this command to run tests.
    sudo cpanm --installdeps .
    NGINX_BIN=${nginx_prefix_dir}/sbin/nginx ./Build test
    # or
    NGINX_BIN=${nginx_prefix_dir}/sbin/nginx prove t/**/*.t

Full Guide Installation

To see what changes have been made to the original nginx_small_light or nginx, please see the UPGRADING file.

Docker

To run the application using docker, you can use the following commands:

docker-compose up -d

To stop the application, you can use the following commands:

docker-compose down

In docker-compose.yml file, we have 2 ports forwarded:

  • 8084: the port for single nginx_small_light
  • 8085: the port for nginx_small_light with juragan cdn like's configuration

Please make sure that the ports are not used by other applications, otherwise you can change the port manually.

Nginx Small Light

nginx_small_light is a module for nginx that can manipulate images with help of ImageMagick. To use nginx_small_light we need to install ImageMagick with enabled webp and avif support, install PCRE, prepare nginx_small_light, and install nginx with nginx_small_light module.

Dependencies

Install some basic dependencies to build all modules.

sudo apt-get install autoconf cmake ninja-build yasm cpanminus

ImageMagick

In order to enable webp and avif support, we need to install some additional libraries such as libwebp and libheif.

  1. Install libwebp to enable webp support.

    sudo apt-get install libwebp-dev
  2. Enable avif support by installing libheif and libaom (aom is a codec library for AV1F video encoding and decoding)

    1. Install libheif dependencies.
      sudo apt-get install libde265-dev libx265-dev x265 libjpeg-dev libtool
    2. Clone libheif.
      git clone https://github.com/strukturag/libheif.git
    3. Install libaom inside libheif third_party folder.
      cd libheif/third_party
      git clone -b v3.5.0 --depth 1 https://aomedia.googlesource.com/aom
      cd aom
      cmake -S . -B build.libavif -G Ninja -DCMAKE_INSTALL_PREFIX="$(pwd)/dist" -DCMAKE_BUILD_TYPE=Release -DENABLE_DOCS=0 -DENABLE_EXAMPLES=0 -DENABLE_TESTDATA=0 -DENABLE_TESTS=0 -DENABLE_TOOLS=0
      ninja -C build.libavif
      ninja -C build.libavif install
      cd ../.. # back to libheif root directory
    4. Export libaom pkgconfig path.
      export PKG_CONFIG_PATH=${folder_to_libheif}/libheif/third-party/aom/dist/lib/pkgconfig
    5. Install libheif using CMake.
      mkdir -p cmake/build
      cd cmake/build
      cmake ../..
      make
      sudo make install
      cd ../../.. # back to root directory
  3. Install ImageMagick.

    git clone https://github.com/ImageMagick/ImageMagick
    cd ImageMagick
    ./configure CFLAGS='-I/usr/local/include/libheif' LDFLAGS='-L/usr/local/lib' --with-heic=yes --with-webp=yes
    make
    sudo make install
    sudo /sbin/ldconfig /usr/local/lib
    make check
    cd .. # back to root directory

    note: Make sure libaom pkgconfig path is exported correctly before installing ImageMagick, see step 2.4.

  4. Check if ImageMagick is installed correctly and support webp and avif.

    convert -list format | grep WEBP
    convert -list format | grep AVIF

ngx_small_light

  1. Install some dependencies.
    sudo apt-get install libpcre2-dev libpcre3 libpcre3-dev
  2. Clone nginx_small_light.
    git clone https://github.com/midorinet/ngx_small_light.git
  3. Prepare nginx_small_light.
    cd ngx_small_light
    ./setup
    cd .. # back to root directory

Nginx

  1. Install nginx from source and add nginx_small_light module.
    wget http://nginx.org/download/nginx-1.22.1.tar.gz
    tar -zxvf nginx-1.22.1.tar.gz
    cd nginx-1.22.1
  2. Modify nginx compilation option by changing following line in auto/cc/clang, auto/cc/gcc, and auto/cc/icc had been commented out to disable error when warning is detected during compilation.
    auto/cc/clang / auto/cc/gcc / auto/cc/icc
    // ######## 
    // ## Some code is omitted.
    // ########
    
    CFLAGS="$CFLAGS -Werror" <== Comment out this line
    
    // ######## 
    // ## Some code is omitted.
    // ########
  3. Continue installing the nginx
     ./configure --add-module=${ngx_small_light_src_dir}
     make
     sudo make install
  4. You can run nginx and check the version.
    sudo nginx
    nginx -v
  5. There are several command to control nginx.
    sudo nginx -s stop
    sudo nginx -s quit
    sudo nginx -s reload
    sudo nginx -s reopen

License

Please read the COPYING.

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published