BRGM : a WebCast
Infrastructure
03/06/2013
–
BRGM WebCast Infrastructure
Olivier Pouvesle
June 3, 2013
>
2
Some figures
:
Main infrastructure
2 datacenters located on BRGM campus (Orléans City)
BRGM internet network
2 Internet access points :
Renater
1Gb/s and
Oléane
400Mb/s
Servers
200 physical servers
500 virtual servers (65 % of
linux
)
Storage, backup
700To SAN and NAS Storage
Library 400 slots et 8 LTO5 tapes
Webcast
500 hosted web sites (285 in production, 215 for testing or
integration)
12 Millions visits in 2012
03/06/2013
–
BRGM WebCast Infrastructure
>
3
Technical infrastructure
03/06/2013
–
BRGM WebCast Infrastructure
>
4
Storage infrastructure
03/06/2013
–
BRGM WebCast Infrastructure
F5 appliance
Webaccelerator
Vmware ESX4
Vcenter 5.1
Netapp FAS
3240C
Ex : Spatial data
>
5
Monitoring
03/06/2013
–
BRGM WebCast Infrastructure
System monitoring
Microsoft System Center Operation Management
External web monitoring
Scenario test
www.netvigie.com
Inspire Analytic
Home made development
>
6
BRGM technical team
Technical
division :
Operating
technicians
O
perating
engineers
Storage
engineers
Network
engineers
Security
engineers
System
administrators
Database
administrators
Software
achitects
…
> 15
supporting
staff
Working
in coordination
with
application
devloppment
team in the
same
information system division.
03/06/2013
–
BRGM WebCast Infrastructure
PROJECT
>
7
How do we work together ?
03/06/2013
–
BRGM WebCast Infrastructure
Project manager /
Development
team
IT team
Project management
>
8
Benefits
Better
SLA
Better
performances
(
optimized
for the BRGM infrastructure and
adaption
of infrastructure
according
to application
requirements
)
Scalable
,
elastic
architecture
Smoother
management of
evolution
Less
deployment
problems
Challenges
Need
staff
with
expertise
Complex
Human
Resource Planning
03/06/2013
–
BRGM WebCast Infrastructure
>
9
Support, Partner and training
Editors & constructors
Oracle
Microsoft
VMWare
NetApp
Exalead
…
Special attention of BRGM on training policy
03/06/2013
–
BRGM WebCast Infrastructure
>
10
Software environment
Operating system
Linux (CentOS)
Windows 2003,2008 R2 and 2012
WebServer
Apache
Tomcat / JBOSS
PHP
IIS / .Net framework
Python
Webmapping server
Mapserver, mapcache, phpmapscript
Database
Oracle, Postgres/Gis, SqlServer/ Mysql
WebAnalytics
Piwik
03/06/2013
–
BRGM WebCast Infrastructure
Directory server
OpenLdap
Active Directory
>
11
Reference databases vs publishing environnements
03/06/2013
–
BRGM WebCast Infrastructure
>
12
Serving geospatial data
Inspire standard requirements
•
Performance
–
GetMap < 5 seconds : image 800x600*8
Caching system, F5 webaccelerator
Precise tuning of each components (OS, Apache..
•
Capacity
–
20 requests per second
Loadbalacing methode on multiple farm server
2000 requests per second on BRGM spatial webservices
architecture
•
Availability
–
99% soit 1,7 hour per week or 7,27 hours per month or 3,63 days per year
Vmware HA system
BRGM webservices 99,9% (2013)
03/06/2013
–
BRGM WebCast Infrastructure
Mapserver & Mapcache
>
Farm
of
VMWare
Virtual server
>
13
03/06/2013
–
BRGM WebCast Infrastructure
Tiles constraint
>
Storage:
•
fast
read
access
•
Specific
File system (
huge
number
of files).
•
example
: 2
based
map
layers
(7 and 4 zoom
levels
)
55 millions files
generated
>
14
>
Updating
data
•
Delete
millions of files
take
time
03/06/2013
–
BRGM WebCast Infrastructure
geospatial Webcast architecture
>
16
Web mapping architecture :
-
CARMEN
(
www.carmencarto.fr
) is a web tool allowing any contributor of a public
authority to push geospatial data, create a map with a online GIS tool and to publish
the information as a web page, download access or like a web service
•
190 data producers
•
8100 OGC webservices
03/06/2013
–
BRGM WebCast Infrastructure
>
17
Carmen :
03/06/2013
–
BRGM WebCast Infrastructure
>
18
Web mapping architecture :
Geofoncier
Unique access point to
land geographic information in France.
GéoFoncier
portal
provides access to the database of all
interventions by
land surveyors since 1997
(boundary map
).
-
BRGM operator for the national association of land surveyors
-
2500 users/per day working on the
backoffice
03/06/2013
–
BRGM WebCast Infrastructure
Geofoncier architecture in 2008:
>
19
03/06/2013
–
BRGM WebCast Infrastructure
Geofoncier:
>
20
>
21
What’s next ?
Oracle
SuperCluster
consolidation of
databases
h
igh
performance
Puppet
Single server configuration management
A
utomatic
server
deployment
Cloud
approch
VMWare
vCloud
Director
Private
cloud
Self service to
automaticaly
delivery
testing
environnement
R&D : Cloud
Computing
Geospatial
services on the
cloud
European
reseach
project
:
InGeoCloud
03/06/2013
–
BRGM WebCast Infrastructure
>
22
Some conclusions 1/2
•
We developed an «
AGILE
» infrastructure to serve
BRGM requirements
•
Costs :
–
regular hardware / software investments
–
highly skilled and trained team of technicians and engineers
•
Benefits :
–
Provides a full control on the whole chain (application development
–
hosting)
–
Permits a cost efficient collaboration between developers and infrastructure
experts
–
Allows an optimal use of the resources
–
Facilitates the smooth evolution according to the end user requirements
03/06/2013
–
BRGM WebCast Infrastructure
>
23
Some conclusions 2/2
The BRGM infrastructure is a key element of the
components that are necessary for the objectives of
BRGM which are to
develop and to serve the best
customised services for our users
03/06/2013
–
BRGM WebCast Infrastructure
Customised
services
Agile
infrastructure
Data
Partnerships
Domain
expertise
Thank you for your attention
o.pouvesle@brgm.fr
>
24
Enter the password to open this PDF file:
File name:
-
File size:
-
Title:
-
Author:
-
Subject:
-
Keywords:
-
Creation Date:
-
Modification Date:
-
Creator:
-
PDF Producer:
-
PDF Version:
-
Page Count:
-
Preparing document for printing…
0%
Σχόλια 0
Συνδεθείτε για να κοινοποιήσετε σχόλιο