Image Processing on Line

molassesitalianAI and Robotics

Nov 6, 2013 (3 years and 8 months ago)

78 views

Image
Processing

on Line

A new
way

to
publish
?

A new
way

to
organize

research

in a
lab
?




Jérôme
Darbon

(UCLA and ENS Cachan),

Nicolas
Limare

(ENS Cachan),

Jean
-
Michel Morel (ENS Cachan)

01/10/2009

1

Image Processing on Line, Minneapolis,
ONR meeting 2009

Research

partially

funded

by ONR Grant N00014
-
97
-
1
-
0839

Image
Processing

on Line: main goal

01/10/2009

2

Image Processing on Line, Minneapolis,
ONR meeting 2009

Achieve

«

reproducible

research

» and
therefore
:


Allow

EVERYBODY to
try

the
algorithms

on
their

own

images (
including

deciders

who

DO NOT program)

Make

all
results

of trials accessible in a Web archive (
experiment

sharing)

D
ownloadable

code

Give

a
list

of
examples

AND
counterexamples
, and
explain

them

Describe

the
algorithms

carefully

(
pseudocode
+
comments
)

T
esting

independent

of
any

platform

(no code
download
, no system
requirement
…)


This
is

particularly

adapted

to image
processing
!

Means

of the
project

01/10/2009

3

Image Processing on Line, Minneapolis,
ONR meeting 2009

Online servers,
multicore

Execution

in real/interactive time (
less

than

20 seconds)

Research

team on online web
tools

Some

(
easy
)
parallel

computing


Reorganization

of the
work

flow in a team




Reorganization

of the
work

flow in a
research

team

01/10/2009

4

Image Processing on Line, Minneapolis,
ONR meeting 2009

Math
theory

and first
algorithm

Elimination

of
parameters
,
private

tests

Internal

web version
tested

on line by the
whole

team, feedback
on code and
theory

List of
examples

and
counterexamples

established

Writing

of the web
site, green light to
online
demo

Submission

of
paper

,
clear

ideas

on future
work

01/10/2009

Image Processing on Line, Minneapolis,
ONR meeting 2009

5

Lab.
Web
server

Internal

lab

workshops,
testing

in group (
private
)
Easy

building blocks for
assembling

a
complex

chain

(
video

processing

stereo
…)

On line
algorithms

to
contractors



(
private
)

Online publication
(
even

for «

well

known

«


algorithms

Teaching

Four
functions

for a Web server

01/10/2009

Image Processing on Line, Minneapolis,
ONR meeting 2009

6

Algorithm

website

Link to code
download
, C
code,
several

platforms

Link to on
line
demo

Link to
publication
reference

or
preprint

Link to
archive of
on line
trials

For
each

algorithm
: a
fourfold

publication

01/10/2009

7

Image Processing on Line, Minneapolis,
ONR meeting 2009

Current

state of the site


PUBLIC ONLINE (
Website

and
demos
):
http://mw.cmla.ens
-
cachan.fr/megawave/algo/
:



ASIFT : Affine Invariant Image
Matching

LSD : Line Segment
Detection

Random

Phase Noise :
Microtexture

Synthesis


Cartoon+Texture Image
Decomposition

Retinex

PDE

Color

Balance



INTERNAL WORKSHOPS:

Color

contrast

enhancement

by PDE (
three

algorithms

compared
)

http://mw.cmla.ens
-
cachan.fr/megawave/demo/retinex_workshop/


NL
-
means

(on test)

http://mw.cmla.ens
-
cachan.fr/megawave/demo/nlmeans/




01/10/2009

8

Image Processing on Line, Minneapolis,
ONR meeting 2009

ASIFT: affine invariant image
comparison

01/10/2009

9

Image Processing on Line, Minneapolis,
ONR meeting 2009

Result

of ASIFT:



Compared

with

SIFT:

01/10/2009

10

Image Processing on Line, Minneapolis,
ONR meeting 2009

Algorithm

Website


01/10/2009

11

Image Processing on Line, Minneapolis,
ONR meeting 2009

The
website

of
each

algorithms

shows and
explains

the
failure

cases. For instance for SIFT

and ASIFT,
failure

comparing

objects

with

night and
day

illumination

01/10/2009

12

Image Processing on Line, Minneapolis,
ONR meeting 2009

The online
demo

gives

also

access

to the online archive.

More
than

1550
different

images

have been
so

far
tried

by on line
users
.
They

are
grouped

in pages of 50.
Here

are
three

e
xamples

tried

by
users
, on a simple box, a building and a
landscape
.

01/10/2009

13

Image Processing on Line, Minneapolis,
ONR meeting 2009

By a simple click a
closer

view

of
each

experiment

is

available
:

ASIFT
result

:





SIFT
result

:


01/10/2009

14

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

15

Image Processing on Line, Minneapolis,
ONR meeting 2009

Line segment detector (LSD), no
parameter
. More
than

850 images in the archive

01/10/2009

16

Image Processing on Line, Minneapolis,
ONR meeting 2009

Some

results

01/10/2009

17

Image Processing on Line, Minneapolis,
ONR meeting 2009

LSD:
Some

results

in
the online archive

01/10/2009

18

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

19

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

20

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

21

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

22

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

23

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

24

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

25

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

26

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

27

Image Processing on Line, Minneapolis,
ONR meeting 2009

Plans

-
Make

a
substantial

database

of
algorithms


. New
ones


. But
many

classic

ones


-
Pass

from

atoms

to
molecules

:


.
Stereo

(calibration,
stereorectification
,
matching
, reconstruction


. Image
processing

(noise,
blur
,
color
,
contrast
:
requires

reliable

estimates
)


-
Official publication?



.
Needs

a
scientific

AND
technical

committee


.
Needs

a union of
labs

to
start

(right
now

three

labs

volunteer
)


.
Needs

to
fix

very

carefully

the
rules

for code description,
examples
, etc.


.
Needs

€€€€€

+ $$$$$



VISIT US:
http://mw.cmla.ens
-
cachan.fr/megawave/algo/
:

01/10/2009

28

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

29

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

30

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

31

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

32

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

33

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

34

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

35

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

36

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

37

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

38

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

39

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

40

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

41

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

42

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

43

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

44

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

45

Image Processing on Line, Minneapolis,
ONR meeting 2009

01/10/2009

46

Image Processing on Line, Minneapolis,
ONR meeting 2009