How to use NUS-8 Camera Dataset

[yt605155624]

hello , In your data folder ,there are only "geheler" for Shi's datasets,and in this folder ,you have set a groundtruth.mat as label,and in the NUS-8 datasets web ,There are many formats for us to download,so can you please tell me which format should I download ,and how To pre-process NUS-8 Camera Dataset as the Shi's datasets,thank you!

[yuanming-hu]

I will take care of it later this week. Sorry for the delay.

[hienpham15]

@yt605155624 For the NUS-8 camera dataset, you only need to download the PNG ones, as they have already done the pre-processing (demosaicing, tone-mapping) on the original HDR images. Then, you can obtain the color images by subtracting the Darkness level (this info is specified for each camera and inside the .mat file) -> convert these PNG images to 8-bit images (because they are 12bit HDR images) -> and gamma linearization. If it helps, this is my code to get the job done.

[yt605155624]

thanks ,there are many other datas except images,for example ground_truth.mat, real_illum.mat coordinates and meta.pkl, I will search for myself if the web has provided this ,or ,I will wait Hu to update this items @hienpham15

[yuanming-hu]

I will start working on it in 3h.

[yuanming-hu]

If you haven't done so, please prepare the PNG versions of the dataset.

[yuanming-hu]

Please organize the data/cheng/ folder like this:

cheng
├── Canon1DsMkIII-meta.pkl
├── ground_truth
│   └── Canon1DsMkIII_gt.mat
└── images
    ├── Canon1DsMkIII_0001.PNG
    ├── Canon1DsMkIII_0002.PNG
    ├── Canon1DsMkIII_0003.PNG
    ├── Canon1DsMkIII_0004.PNG
    ├── Canon1DsMkIII_0005.PNG
    ├── Canon1DsMkIII_0006.PNG
    ├── Canon1DsMkIII_0007.PNG
    ├── Canon1DsMkIII_0008.PNG
    ├── Canon1DsMkIII_0009.PNG
    ├── Canon1DsMkIII_0010.PNG
    ├── Canon1DsMkIII_0011.PNG
    ├── Canon1DsMkIII_0012.PNG
    ├── Canon1DsMkIII_0013.PNG
    ├── Canon1DsMkIII_0014.PNG
    ├── Canon1DsMkIII_0015.PNG
    ├── Canon1DsMkIII_0016.PNG
    ├── Canon1DsMkIII_0017.PNG
    ├── Canon1DsMkIII_0018.PNG
    ├── Canon1DsMkIII_0019.PNG
    ├── Canon1DsMkIII_0020.PNG
    ├── Canon1DsMkIII_0021.PNG
    ├── Canon1DsMkIII_0022.PNG
    ├── Canon1DsMkIII_0023.PNG
    ├── Canon1DsMkIII_0024.PNG
    ├── Canon1DsMkIII_0025.PNG
    ├── Canon1DsMkIII_0026.PNG
    ├── Canon1DsMkIII_0027.PNG
    ├── Canon1DsMkIII_0028.PNG
    ├── Canon1DsMkIII_0029.PNG
    ├── Canon1DsMkIII_0030.PNG
    ├── Canon1DsMkIII_0031.PNG
    ├── Canon1DsMkIII_0032.PNG
    ├── Canon1DsMkIII_0033.PNG
    ├── Canon1DsMkIII_0034.PNG
    ├── Canon1DsMkIII_0035.PNG
    ├── Canon1DsMkIII_0036.PNG
    ├── Canon1DsMkIII_0037.PNG
    ├── Canon1DsMkIII_0038.PNG
    ├── Canon1DsMkIII_0039.PNG
    ├── Canon1DsMkIII_0040.PNG
    ├── Canon1DsMkIII_0041.PNG
    ├── Canon1DsMkIII_0042.PNG
    ├── Canon1DsMkIII_0043.PNG
    ├── Canon1DsMkIII_0044.PNG
    ├── Canon1DsMkIII_0045.PNG
    ├── Canon1DsMkIII_0046.PNG
    ├── Canon1DsMkIII_0047.PNG
    ├── Canon1DsMkIII_0048.PNG
    ├── Canon1DsMkIII_0049.PNG
    ├── Canon1DsMkIII_0050.PNG
    ├── Canon1DsMkIII_0051.PNG
    ├── Canon1DsMkIII_0052.PNG
    ├── Canon1DsMkIII_0053.PNG
    ├── Canon1DsMkIII_0054.PNG
    ├── Canon1DsMkIII_0055.PNG
    ├── Canon1DsMkIII_0056.PNG
    ├── Canon1DsMkIII_0057.PNG
    ├── Canon1DsMkIII_0058.PNG
    ├── Canon1DsMkIII_0059.PNG
    ├── Canon1DsMkIII_0060.PNG
    ├── Canon1DsMkIII_0061.PNG
    ├── Canon1DsMkIII_0062.PNG
    ├── Canon1DsMkIII_0063.PNG
    ├── Canon1DsMkIII_0064.PNG
    ├── Canon1DsMkIII_0065.PNG
    ├── Canon1DsMkIII_0066.PNG
    ├── Canon1DsMkIII_0067.PNG
    ├── Canon1DsMkIII_0068.PNG
    ├── Canon1DsMkIII_0069.PNG
    ├── Canon1DsMkIII_0070.PNG
    ├── Canon1DsMkIII_0071.PNG
    ├── Canon1DsMkIII_0072.PNG
    ├── Canon1DsMkIII_0073.PNG
    ├── Canon1DsMkIII_0074.PNG
    ├── Canon1DsMkIII_0075.PNG
    ├── Canon1DsMkIII_0076.PNG
    ├── Canon1DsMkIII_0077.PNG
    ├── Canon1DsMkIII_0078.PNG
    ├── Canon1DsMkIII_0079.PNG
    ├── Canon1DsMkIII_0080.PNG
    ├── Canon1DsMkIII_0081.PNG
    ├── Canon1DsMkIII_0082.PNG
    ├── Canon1DsMkIII_0083.PNG
    ├── Canon1DsMkIII_0084.PNG
    ├── Canon1DsMkIII_0085.PNG
    ├── Canon1DsMkIII_0086.PNG
    ├── Canon1DsMkIII_0087.PNG
    ├── Canon1DsMkIII_0088.PNG
    ├── Canon1DsMkIII_0089.PNG
    ├── Canon1DsMkIII_0090.PNG
    ├── Canon1DsMkIII_0091.PNG
    ├── Canon1DsMkIII_0092.PNG
    ├── Canon1DsMkIII_0093.PNG
    ├── Canon1DsMkIII_0094.PNG
    ├── Canon1DsMkIII_0095.PNG
    ├── Canon1DsMkIII_0096.PNG
    ├── Canon1DsMkIII_0097.PNG
    ├── Canon1DsMkIII_0098.PNG
    ├── Canon1DsMkIII_0099.PNG
    ├── Canon1DsMkIII_0100.PNG
    ├── Canon1DsMkIII_0101.PNG
    ├── Canon1DsMkIII_0102.PNG
    ├── Canon1DsMkIII_0103.PNG
    ├── Canon1DsMkIII_0104.PNG
    ├── Canon1DsMkIII_0105.PNG
    ├── Canon1DsMkIII_0106.PNG
    ├── Canon1DsMkIII_0107.PNG
    ├── Canon1DsMkIII_0108.PNG
    ├── Canon1DsMkIII_0109.PNG
    ├── Canon1DsMkIII_0110.PNG
    ├── Canon1DsMkIII_0111.PNG
    ├── Canon1DsMkIII_0112.PNG
    ├── Canon1DsMkIII_0113.PNG
    ├── Canon1DsMkIII_0114.PNG
    ├── Canon1DsMkIII_0115.PNG
    ├── Canon1DsMkIII_0116.PNG
    ├── Canon1DsMkIII_0117.PNG
    ├── Canon1DsMkIII_0118.PNG
    ├── Canon1DsMkIII_0119.PNG
    ├── Canon1DsMkIII_0120.PNG
    ├── Canon1DsMkIII_0121.PNG
    ├── Canon1DsMkIII_0122.PNG
    ├── Canon1DsMkIII_0123.PNG
    ├── Canon1DsMkIII_0124.PNG
    ├── Canon1DsMkIII_0125.PNG
    ├── Canon1DsMkIII_0126.PNG
    ├── Canon1DsMkIII_0127.PNG
    ├── Canon1DsMkIII_0128.PNG
    ├── Canon1DsMkIII_0129.PNG
    ├── Canon1DsMkIII_0130.PNG
    ├── Canon1DsMkIII_0131.PNG
    ├── Canon1DsMkIII_0132.PNG
    ├── Canon1DsMkIII_0133.PNG
    ├── Canon1DsMkIII_0134.PNG
    ├── Canon1DsMkIII_0135.PNG
    ├── Canon1DsMkIII_0136.PNG
    ├── Canon1DsMkIII_0137.PNG
    ├── Canon1DsMkIII_0138.PNG
    ├── Canon1DsMkIII_0139.PNG
    ├── Canon1DsMkIII_0140.PNG
    ├── Canon1DsMkIII_0141.PNG
    ├── Canon1DsMkIII_0142.PNG
    ├── Canon1DsMkIII_0143.PNG
    ├── Canon1DsMkIII_0144.PNG
    ├── Canon1DsMkIII_0145.PNG
    ├── Canon1DsMkIII_0146.PNG
    ├── Canon1DsMkIII_0147.PNG
    ├── Canon1DsMkIII_0148.PNG
    ├── Canon1DsMkIII_0149.PNG
    ├── Canon1DsMkIII_0150.PNG
    ├── Canon1DsMkIII_0151.PNG
    ├── Canon1DsMkIII_0152.PNG
    ├── Canon1DsMkIII_0153.PNG
    ├── Canon1DsMkIII_0154.PNG
    ├── Canon1DsMkIII_0155.PNG
    ├── Canon1DsMkIII_0156.PNG
    ├── Canon1DsMkIII_0157.PNG
    ├── Canon1DsMkIII_0158.PNG
    ├── Canon1DsMkIII_0159.PNG
    ├── Canon1DsMkIII_0160.PNG
    ├── Canon1DsMkIII_0161.PNG
    ├── Canon1DsMkIII_0162.PNG
    ├── Canon1DsMkIII_0163.PNG
    ├── Canon1DsMkIII_0164.PNG
    ├── Canon1DsMkIII_0165.PNG
    ├── Canon1DsMkIII_0166.PNG
    ├── Canon1DsMkIII_0167.PNG
    ├── Canon1DsMkIII_0168.PNG
    ├── Canon1DsMkIII_0169.PNG
    ├── Canon1DsMkIII_0170.PNG
    ├── Canon1DsMkIII_0171.PNG
    ├── Canon1DsMkIII_0172.PNG
    ├── Canon1DsMkIII_0173.PNG
    ├── Canon1DsMkIII_0174.PNG
    ├── Canon1DsMkIII_0175.PNG
    ├── Canon1DsMkIII_0176.PNG
    ├── Canon1DsMkIII_0177.PNG
    ├── Canon1DsMkIII_0178.PNG
    ├── Canon1DsMkIII_0179.PNG
    ├── Canon1DsMkIII_0180.PNG
    ├── Canon1DsMkIII_0181.PNG
    ├── Canon1DsMkIII_0182.PNG
    ├── Canon1DsMkIII_0183.PNG
    ├── Canon1DsMkIII_0184.PNG
    ├── Canon1DsMkIII_0185.PNG
    ├── Canon1DsMkIII_0186.PNG
    ├── Canon1DsMkIII_0187.PNG
    ├── Canon1DsMkIII_0188.PNG
    ├── Canon1DsMkIII_0189.PNG
    ├── Canon1DsMkIII_0190.PNG
    ├── Canon1DsMkIII_0191.PNG
    ├── Canon1DsMkIII_0192.PNG
    ├── Canon1DsMkIII_0193.PNG
    ├── Canon1DsMkIII_0194.PNG
    ├── Canon1DsMkIII_0195.PNG
    ├── Canon1DsMkIII_0196.PNG
    ├── Canon1DsMkIII_0197.PNG
    ├── Canon1DsMkIII_0198.PNG
    ├── Canon1DsMkIII_0199.PNG
    ├── Canon1DsMkIII_0200.PNG
    ├── Canon1DsMkIII_0201.PNG
    ├── Canon1DsMkIII_0202.PNG
    ├── Canon1DsMkIII_0203.PNG
    ├── Canon1DsMkIII_0204.PNG
    ├── Canon1DsMkIII_0205.PNG
    ├── Canon1DsMkIII_0206.PNG
    ├── Canon1DsMkIII_0207.PNG
    ├── Canon1DsMkIII_0208.PNG
    ├── Canon1DsMkIII_0209.PNG
    ├── Canon1DsMkIII_0210.PNG
    ├── Canon1DsMkIII_0211.PNG
    ├── Canon1DsMkIII_0212.PNG
    ├── Canon1DsMkIII_0213.PNG
    ├── Canon1DsMkIII_0214.PNG
    ├── Canon1DsMkIII_0215.PNG
    ├── Canon1DsMkIII_0216.PNG
    ├── Canon1DsMkIII_0217.PNG
    ├── Canon1DsMkIII_0218.PNG
    ├── Canon1DsMkIII_0219.PNG
    ├── Canon1DsMkIII_0220.PNG
    ├── Canon1DsMkIII_0221.PNG
    ├── Canon1DsMkIII_0222.PNG
    ├── Canon1DsMkIII_0223.PNG
    ├── Canon1DsMkIII_0224.PNG
    ├── Canon1DsMkIII_0225.PNG
    ├── Canon1DsMkIII_0226.PNG
    ├── Canon1DsMkIII_0227.PNG
    ├── Canon1DsMkIII_0228.PNG
    ├── Canon1DsMkIII_0229.PNG
    ├── Canon1DsMkIII_0230.PNG
    ├── Canon1DsMkIII_0231.PNG
    ├── Canon1DsMkIII_0232.PNG
    ├── Canon1DsMkIII_0233.PNG
    ├── Canon1DsMkIII_0234.PNG
    ├── Canon1DsMkIII_0235.PNG
    ├── Canon1DsMkIII_0236.PNG
    ├── Canon1DsMkIII_0237.PNG
    ├── Canon1DsMkIII_0238.PNG
    ├── Canon1DsMkIII_0239.PNG
    ├── Canon1DsMkIII_0240.PNG
    ├── Canon1DsMkIII_0241.PNG
    ├── Canon1DsMkIII_0242.PNG
    ├── Canon1DsMkIII_0243.PNG
    ├── Canon1DsMkIII_0244.PNG
    ├── Canon1DsMkIII_0245.PNG
    ├── Canon1DsMkIII_0246.PNG
    ├── Canon1DsMkIII_0247.PNG
    ├── Canon1DsMkIII_0248.PNG
    ├── Canon1DsMkIII_0249.PNG
    ├── Canon1DsMkIII_0250.PNG
    ├── Canon1DsMkIII_0251.PNG
    ├── Canon1DsMkIII_0252.PNG
    ├── Canon1DsMkIII_0253.PNG
    ├── Canon1DsMkIII_0254.PNG
    ├── Canon1DsMkIII_0255.PNG
    ├── Canon1DsMkIII_0256.PNG
    ├── Canon1DsMkIII_0257.PNG
    ├── Canon1DsMkIII_0258.PNG
    └── Canon1DsMkIII_0259.PNG 

To preprocess the data, run in datasets.py

  ds = ChengDataSet(0) # Canon1DsMkIII is camera id 0
  ds.regenerate_meta_data()
  ds.regenerate_image_packs()

It's too late on my side and let me write an automatic script the all these (possibly tomorrow). Sorry, I get too busy recently.

[yuanming-hu]

I don't think I will have time for this automatic script before the SIGGRAPH Asia deadline - please just do it manually for now. Thanks.

[yuanming-hu]

You may also want to change DATASET_NAME to 'cheng', SUBSET to 0...7 to train on the NUS-8 dataset

[yt605155624]

@yuanming-hu hello,are the final result of datasets NUS-8 Camera Dataset the average of SUBSET 0.....7?

[yuanming-hu]

Hi,

There are 8 parts for the NUS-8 camera dataset.
For each part, there are three folds. The performance on this part should be computed using 3-fold cross-validation. You will need to train 24 models in total.

After you get the performance on each part, for each metric (e.g. tri-mean or median), the performance over the whole dataset should be the geometric mean of the 8 metrics on each of the data set.

[realwill]

@yuanming-hu Great job and thank you for share your code. I use your shared script, and the test results are different from the download RAW and JPG, which are lighter than the test results.

[anth2o]

Hi,
I tried to use the NUS-8 dataset but I can't process correctly the images. I downloaded the PNG and applied the script you provided in datasets.py. Unfortunately, it seems that the result isn't what's expected. Here is below an example of an image processed, stored in the pickle file :

And here is the final image when I apply the gamma correction :

And if I correct the image's illumination with the Von Kries method I got such a picture :

But the JPG image looks like this :

The PNG image processed is way darker and has less contrast than the JPG image. Do you know how to process the PNG image correctly to have a quality similar as the one of JPEG ?

The picture is Canon1DsMkIII_0226, and is the third image in the first pickle file.

Thanks in advance

[a2108870]

The website of NUS dataset seems to be closed. Who can provide other download methods? Many thanks.

[zhangshen12356]

The website of NUS dataset seems to be closed. Who can provide other download methods? Many thanks.

http://cvil.eecs.yorku.ca/projects/public_html/illuminant/illuminant.html

[fang8023]

The website of NUS dataset seems to be closed. Who can provide other download methods?
http://cvil.eecs.yorku.ca/projects/public_html/illuminant/illuminant.html