BRGM WebCast Infrastructure

seedgemsbokΑποθήκευση

10 Δεκ 2013 (πριν από 3 χρόνια και 10 μήνες)

229 εμφανίσεις

BRGM : a WebCast
Infrastructure

03/06/2013


BRGM WebCast Infrastructure

Olivier Pouvesle

June 3, 2013


>

2

Some figures
:


Main infrastructure


2 datacenters located on BRGM campus (Orléans City)


BRGM internet network


2 Internet access points :
Renater

1Gb/s and
Oléane

400Mb/s


Servers


200 physical servers


500 virtual servers (65 % of
linux
)


Storage, backup


700To SAN and NAS Storage


Library 400 slots et 8 LTO5 tapes


Webcast


500 hosted web sites (285 in production, 215 for testing or
integration)


12 Millions visits in 2012





03/06/2013


BRGM WebCast Infrastructure


>

3

Technical infrastructure

03/06/2013


BRGM WebCast Infrastructure


>

4

Storage infrastructure

03/06/2013


BRGM WebCast Infrastructure

F5 appliance

Webaccelerator

Vmware ESX4

Vcenter 5.1

Netapp FAS
3240C

Ex : Spatial data


>

5

Monitoring

03/06/2013


BRGM WebCast Infrastructure


System monitoring


Microsoft System Center Operation Management



External web monitoring


Scenario test


www.netvigie.com



Inspire Analytic


Home made development




>

6

BRGM technical team


Technical

division :



Operating
technicians


O
perating
engineers


Storage
engineers


Network
engineers


Security
engineers


System
administrators


Database

administrators


Software
achitects





> 15
supporting

staff


Working

in coordination
with

application
devloppment

team in the
same

information system division.





03/06/2013


BRGM WebCast Infrastructure


PROJECT


>

7

How do we work together ?

03/06/2013


BRGM WebCast Infrastructure

Project manager /
Development

team



IT team


Project management



>

8

Benefits


Better

SLA



Better

performances
(
optimized

for the BRGM infrastructure and
adaption

of infrastructure
according

to application
requirements
)



Scalable
,
elastic

architecture



Smoother

management of
evolution



Less

deployment

problems



Challenges


Need

staff
with

expertise


Complex

Human

Resource Planning




03/06/2013


BRGM WebCast Infrastructure


>

9

Support, Partner and training


Editors & constructors


Oracle


Microsoft


VMWare


NetApp


Exalead









Special attention of BRGM on training policy






03/06/2013


BRGM WebCast Infrastructure


>

10

Software environment


Operating system


Linux (CentOS)


Windows 2003,2008 R2 and 2012


WebServer


Apache


Tomcat / JBOSS


PHP


IIS / .Net framework


Python


Webmapping server


Mapserver, mapcache, phpmapscript


Database


Oracle, Postgres/Gis, SqlServer/ Mysql



WebAnalytics


Piwik

03/06/2013


BRGM WebCast Infrastructure


Directory server



OpenLdap



Active Directory




>

11

Reference databases vs publishing environnements

03/06/2013


BRGM WebCast Infrastructure


>

12

Serving geospatial data


Inspire standard requirements


Performance


GetMap < 5 seconds : image 800x600*8


Caching system, F5 webaccelerator


Precise tuning of each components (OS, Apache..


Capacity


20 requests per second


Loadbalacing methode on multiple farm server


2000 requests per second on BRGM spatial webservices
architecture



Availability


99% soit 1,7 hour per week or 7,27 hours per month or 3,63 days per year


Vmware HA system


BRGM webservices 99,9% (2013)






03/06/2013


BRGM WebCast Infrastructure

Mapserver & Mapcache

>
Farm

of
VMWare

Virtual server








>

13

03/06/2013


BRGM WebCast Infrastructure

Tiles constraint

>
Storage:


fast

read

access


Specific

File system (
huge

number

of files).



example
: 2
based

map

layers

(7 and 4 zoom
levels
)



55 millions files
generated







>

14

>
Updating

data


Delete

millions of files
take

time






03/06/2013


BRGM WebCast Infrastructure

geospatial Webcast architecture


>

16

Web mapping architecture :


-

CARMEN

(
www.carmencarto.fr

) is a web tool allowing any contributor of a public
authority to push geospatial data, create a map with a online GIS tool and to publish
the information as a web page, download access or like a web service



190 data producers


8100 OGC webservices

03/06/2013


BRGM WebCast Infrastructure


>

17

Carmen :

03/06/2013


BRGM WebCast Infrastructure


>

18

Web mapping architecture :


Geofoncier

Unique access point to
land geographic information in France.
GéoFoncier

portal
provides access to the database of all
interventions by
land surveyors since 1997
(boundary map
).


-

BRGM operator for the national association of land surveyors

-

2500 users/per day working on the
backoffice



03/06/2013


BRGM WebCast Infrastructure

Geofoncier architecture in 2008:


>

19

03/06/2013


BRGM WebCast Infrastructure

Geofoncier:


>

20


>

21

What’s next ?


Oracle
SuperCluster


consolidation of
databases


h
igh

performance



Puppet



Single server configuration management


A
utomatic

server
deployment


Cloud
approch




VMWare

vCloud

Director


Private

cloud


Self service to
automaticaly

delivery

testing

environnement



R&D : Cloud
Computing


Geospatial

services on the
cloud


European

reseach

project

:
InGeoCloud



03/06/2013


BRGM WebCast Infrastructure


>

22

Some conclusions 1/2



We developed an «

AGILE

» infrastructure to serve
BRGM requirements



Costs :


regular hardware / software investments



highly skilled and trained team of technicians and engineers




Benefits :


Provides a full control on the whole chain (application development


hosting)


Permits a cost efficient collaboration between developers and infrastructure
experts


Allows an optimal use of the resources


Facilitates the smooth evolution according to the end user requirements


03/06/2013


BRGM WebCast Infrastructure


>

23

Some conclusions 2/2


The BRGM infrastructure is a key element of the
components that are necessary for the objectives of
BRGM which are to
develop and to serve the best
customised services for our users




03/06/2013


BRGM WebCast Infrastructure

Customised
services

Agile
infrastructure

Data

Partnerships

Domain
expertise

Thank you for your attention



o.pouvesle@brgm.fr



>

24