BRGM WebCast Infrastructure

BRGM : a WebCast
Infrastructure

03/06/2013
–

BRGM WebCast Infrastructure

Olivier Pouvesle

June 3, 2013


>

2

Some figures
:


Main infrastructure


2 datacenters located on BRGM campus (Orléans City)


BRGM internet network


2 Internet access points :
Renater

1Gb/s and
Oléane

400Mb/s


Servers


200 physical servers


500 virtual servers (65 % of
linux
)


Storage, backup


700To SAN and NAS Storage


Library 400 slots et 8 LTO5 tapes


Webcast


500 hosted web sites (285 in production, 215 for testing or
integration)


12 Millions visits in 2012





03/06/2013
–

BRGM WebCast Infrastructure


>

3

Technical infrastructure

03/06/2013
–

BRGM WebCast Infrastructure


>

4

Storage infrastructure

03/06/2013
–

BRGM WebCast Infrastructure

F5 appliance

Webaccelerator

Vmware ESX4

Vcenter 5.1

Netapp FAS
3240C

Ex : Spatial data


>

5

Monitoring

03/06/2013
–

BRGM WebCast Infrastructure


System monitoring


Microsoft System Center Operation Management



External web monitoring


Scenario test


www.netvigie.com



Inspire Analytic


Home made development




>

6

BRGM technical team


Technical

division :



Operating
technicians


O
perating
engineers


Storage
engineers


Network
engineers


Security
engineers


System
administrators


Database

administrators


Software
achitects


…


> 15
supporting

staff


Working

in coordination
with

application
devloppment

team in the
same

information system division.





03/06/2013
–

BRGM WebCast Infrastructure


PROJECT


>

7

How do we work together ?

03/06/2013
–

BRGM WebCast Infrastructure

Project manager /
Development

team



IT team


Project management



>

8

Benefits


Better

SLA



Better

performances
(
optimized

for the BRGM infrastructure and
adaption

of infrastructure
according

to application
requirements
)



Scalable
,
elastic

architecture



Smoother

management of
evolution



Less

deployment

problems



Challenges


Need

staff
with

expertise


Complex

Human

Resource Planning




03/06/2013
–

BRGM WebCast Infrastructure


>

9

Support, Partner and training


Editors & constructors


Oracle


Microsoft


VMWare


NetApp


Exalead


…






Special attention of BRGM on training policy






03/06/2013
–

BRGM WebCast Infrastructure


>

10

Software environment


Operating system


Linux (CentOS)


Windows 2003,2008 R2 and 2012


WebServer


Apache


Tomcat / JBOSS


PHP


IIS / .Net framework


Python


Webmapping server


Mapserver, mapcache, phpmapscript


Database


Oracle, Postgres/Gis, SqlServer/ Mysql



WebAnalytics


Piwik

03/06/2013
–

BRGM WebCast Infrastructure


Directory server



OpenLdap



Active Directory




>

11

Reference databases vs publishing environnements

03/06/2013
–

BRGM WebCast Infrastructure


>

12

Serving geospatial data


Inspire standard requirements

•
Performance

–
GetMap < 5 seconds : image 800x600*8


Caching system, F5 webaccelerator


Precise tuning of each components (OS, Apache..

•
Capacity

–
20 requests per second


Loadbalacing methode on multiple farm server


2000 requests per second on BRGM spatial webservices
architecture


•
Availability

–
99% soit 1,7 hour per week or 7,27 hours per month or 3,63 days per year


Vmware HA system


BRGM webservices 99,9% (2013)






03/06/2013
–

BRGM WebCast Infrastructure

Mapserver & Mapcache

>
Farm

of
VMWare

Virtual server








>

13

03/06/2013
–

BRGM WebCast Infrastructure

Tiles constraint

>
Storage:

•
fast

read

access

•
Specific

File system (
huge

number

of files).


•
example
: 2
based

map

layers

(7 and 4 zoom
levels
)



55 millions files
generated







>

14

>
Updating

data

•
Delete

millions of files
take

time






03/06/2013
–

BRGM WebCast Infrastructure

geospatial Webcast architecture


>

16

Web mapping architecture :


-

CARMEN

(
www.carmencarto.fr

) is a web tool allowing any contributor of a public
authority to push geospatial data, create a map with a online GIS tool and to publish
the information as a web page, download access or like a web service


•
190 data producers

•
8100 OGC webservices

03/06/2013
–

BRGM WebCast Infrastructure


>

17

Carmen :

03/06/2013
–

BRGM WebCast Infrastructure


>

18

Web mapping architecture :


Geofoncier

Unique access point to
land geographic information in France.
GéoFoncier

portal
provides access to the database of all
interventions by
land surveyors since 1997
(boundary map
).


-

BRGM operator for the national association of land surveyors

-

2500 users/per day working on the
backoffice



03/06/2013
–

BRGM WebCast Infrastructure

Geofoncier architecture in 2008:


>

19

03/06/2013
–

BRGM WebCast Infrastructure

Geofoncier:


>

20


>

21

What’s next ?


Oracle
SuperCluster


consolidation of
databases


h
igh

performance



Puppet



Single server configuration management


A
utomatic

server
deployment


Cloud
approch




VMWare

vCloud

Director


Private

cloud


Self service to
automaticaly

delivery

testing

environnement



R&D : Cloud
Computing


Geospatial

services on the
cloud


European

reseach

project

:
InGeoCloud



03/06/2013
–

BRGM WebCast Infrastructure


>

22

Some conclusions 1/2


•
We developed an «

AGILE

» infrastructure to serve
BRGM requirements


•
Costs :

–
regular hardware / software investments

–

highly skilled and trained team of technicians and engineers



•
Benefits :

–
Provides a full control on the whole chain (application development
–

hosting)

–
Permits a cost efficient collaboration between developers and infrastructure
experts

–
Allows an optimal use of the resources

–
Facilitates the smooth evolution according to the end user requirements


03/06/2013
–

BRGM WebCast Infrastructure


>

23

Some conclusions 2/2


The BRGM infrastructure is a key element of the
components that are necessary for the objectives of
BRGM which are to
develop and to serve the best
customised services for our users




03/06/2013
–

BRGM WebCast Infrastructure

Customised
services

Agile
infrastructure

Data

Partnerships

Domain
expertise

Thank you for your attention



o.pouvesle@brgm.fr



>

24