Available Resources
SPRACE Cluster
The SPRACE cluster is a T2 site of the CMS collaboration at the
Worldwide LHC Computing Grid (WLCG)
infrastructure.
General Summary
Worker Nodes summary
SPRACE has 80 worker nodes corersponding to 320 computing cores. Those servers were bought at different times (phases), according to the evolution of the project, that started in 2004.
By the end of may equipments acquired in phase V will be installed, corresponding to more 64 workernodes/768 cores. By this time
equipment of phase 2 will be decommissioned because they do not attend the minimum recomended amount of RAM memory per core
by WLCG, which is 1.5GB/core.
Phase |
Vendor |
Model |
Processor |
Cores |
RAM |
# of nodes |
Total HS06 |
IV |
SGI |
altix xe 340SGI |
2 x Intel Xeon Quad-Core E5620 @ 2.40 GHz |
8 |
24GB |
16 |
1,948 (*) |
II |
Itautec |
Infoserver LX210 |
2 x Intel Xeon EMT64T @ 3.0 GHz |
2 |
2GB |
32 |
372 |
III |
Itautec |
Infoserver LX211 |
2 x Intel Xeon Dual-Core 5130 @ 2.0 GHz |
4 |
4GB |
32 |
990 (*) |
V |
SGI |
still head |
2 x Intel Xeon Hexa-Core E5-2630 @ 2.30 GHz |
12 |
48GB |
64 |
10,747 (**) |
(*) HEPSPEC06 benchmarks from
https://www.gridpp.ac.uk/wiki/HEPSPEC06. Values for Centos 5.3 - 64bit, gcc 4.1.2, and same amount fo ram memory as in our servers. For each server with 2 x Intel Xeon Dual-Core 5130 @ 2.0 GHz the HEPSPEC06 is 30.95 and for each server with 2 x Intel Xeon Quad-Core E5620 @ 2.40 GHz the HEPSPEC06 is 121.75.
(**) Estimate for the HS06 vlaue for the processor E5-2630 based in the SPEC CINT 2006 values for the processors E5620 (~29) and E5-2630 (~40), extracted from
http://www.spec.org/cpu2006/results/cint2006.html .
Storage summary
SPRACE has a
dCache based storage with
372TiB of effecive disk space, distributed in three SunFire (48TB raw disk space) servers, and in five Supermicro (72TB raw disk space) servers.
Phase |
Vendor |
Model |
Processor |
Cores |
RAM |
Disk Space |
# of nodes |
IV |
Sun |
SunFire X4540 |
2 x AMD Opteron Quad-Core 2384 @ 2.7 GHz |
8 |
64GB |
34TiB |
3 |
IV |
Supermicro |
MBD-X8DTI-F |
2 x Intel Xeon Quad-Core E5620 @ 2.4GHz |
8 |
24GB |
54TiB |
5 |
V |
SGI |
Summit + Infinite Storage 2245 |
2 x Intel Xeon Quad-Core E5620 @ 2.4GHz |
12 |
64GB |
102TiB |
4 |
Head Nodes summary
SPRACE has 5 head nodes, one for local users access (access), one for open sience grid compute element middleware (osg-ce), one for open sience grid storage element middleware (osg-se), and two for general tasks (spserv01 and spserv02).
- access.sprace.org.br
- Silicon Graphics Inc. model altix xe 270
- 02 processors Intel(R) Xeon(R) E5620 @ 2.40GHz, cache 12288 KB ( total: 8 cores )
- RAM 24GB
- /dev/sda 280 GB
- /dev/sdb - 2.5 TB (4x1TB ST31000340NS)
- osg-ce.sprace.org.br
- Silicon Graphics Inc. model altix xe 270
- 02 processors Intel(R) Xeon(R) E5620 @ 2.40GHz, cache 12288 KB ( total: 8 cores )
- RAM 24GB
- /dev/sda 1.0 TB (RAID-5 3x500GB ST3500320NS)
- osg-se.sprace.org.br
- Silicon Graphics Inc. model altix xe 270
- 02 processors Intel(R) Xeon(R) E5620 @ 2.40GHz, cache 12288 KB ( total: 8 cores )
- RAM 24GB
- /dev/sda 1.0 TB (RAID-5 3x500GB ST3500320NS)
- spserv01.sprace.org.br
- Silicon Graphics Inc. model altix xe 270
- 02 processors Intel(R) Xeon(R) E5620 @ 2.40GHz, cache 12288 KB ( total: 8 cores )
- RAM 24GB
- /dev/sda 1.0 TB (RAID-5 3x500GB ST3500320NS)
- spserv02.sprace.org.br
- Silicon Graphics Inc. model altix xe 270
- 02 processors Intel(R) Xeon(R) E5620 @ 2.40GHz, cache 12288 KB ( total: 8 cores )
- RAM 24GB
- /dev/sda 280 GB
- /dev/sdb - 2.5 TB (4x1TB ST31000340NS)
Decommissioned Hardware
Some machines, bought at phase I of the project, were decommissioned because they were based on a 32 bits architecture.
Other machines bought at phase II were also decommissioned because their hardware warranty has expired.
Processing hardware
Storage hardware
WLCG pledges
WLCG pledges for 2012
According to the WLCG pledges for 2012, a nominal T2 site is
- 10.9 KHS06 of Processing Ressources
- 810TB of Disk Space
- 30TB of Stage-Out Space
- 250TB of Group Space (125TB per group)
- 200TB of Central Space
- 170TB of Local Space
- 160TB of User Space (~40 Users of 4TB each).
SPRACE status on March 2012
The current SPRACE status is
- 2.63 KHS06 of Processing Ressources
- 372TB of Disk Space
- 20TB of Stage-Out Space
- 100TB of Group Space (125 TB per group)
- 100TB of Central Space
- 80TB of Local Space
- 72TB of User Space (~40 Users of 4 TB each).
SPRACE status after V phase
After the next upgrade, corresponding to phase V, that will be installed by the end of may,
the SPRACE status will be
- 10 KHS06 of Processing Ressources
- 770TB of Disk Space
- 30TB of Stage-Out Space
- 250TB of Group Space (125 TB per group)
- 200TB of Central Space
- 170TB of Local Space
- 120TB of User Space (~40 Users of 4 TB each).