Difference between revisions of "Bureau Infrastructure"

From CNM Wiki
Jump to: navigation, search
(→‎Node 1 hardware)
 
(25 intermediate revisions by the same user not shown)
Line 1: Line 1:
−
[[Bureau Infrastructure]] is the software and hardware that [[CNMCyber Team]] rents from [[Hetzner]] to host [[CNM Bureau Farm]]. The rented software and hardware consists of [[#The Metal]] and [[#The Bridges]]. Both are parts of [[Opplet Infrastructure]].
+
[[Bureau Infrastructure]] (hereinafter, [[#The Infra]]) is the software and hardware that [[CNMCyber Team]] rents to host [[CNM Bureau Farm]]. The rented software and hardware consists of [[#The Metal]] and [[#The Bridges]]. Both are parts of [[Opplet Infrastructure]].
  
  
−
==Provider and costs==
+
==In a nutshell==
 +
 
 +
===Needs to satisfy===
 +
: In [[Opplet Infrastructure]], [[#The Infra]] is the newest, most expensive part. It hosts the most critical pieces of [[Opplet]]'s software such as [[Opplet.net]], [[CNMCyber.com]], and [[CNM Corp]]. To ensure [[high availability]] ([[high availability|HA]]) of the hosted software, it includes three [[bare-metal server]]s.
  
 
===The Provider===
 
===The Provider===
−
: For the purposes of this very wikipage, the ''Provider'' refers to [[Hetzner]], which has been serving as [[#The Team]]'s [[Internet service provider]] ([[Internet service provider|ISP]]) and lessor of [[#The Infrastructure]] since 2016. Offers from other potential providers, specifically, [[Contabo]] and [[DigitalOcean]], have been periodically reviewed, but no one else has offered any better quality/price rate on a long-term basis.
+
: For the purposes of this very wikipage, the ''Provider'' refers to [[Hetzner]], which has been serving as [[#The Team]]'s [[Internet service provider]] ([[Internet service provider|ISP]]) and lessor of both [[#The Infra]] and [[Lab Infrastructure]] since 2016. Offers from other potential providers, specifically, [[Contabo]] and [[DigitalOcean]], have been periodically reviewed, but no one else has offered any better quality/price rate on a long-term basis.
  
 
===Costs===
 
===Costs===
Line 11: Line 14:
 
!Category
 
!Category
 
|Product
 
|Product
−
!Description!!Quantity!!Unit Price!!Price (excl. VAT)
+
!Description!!Quantity!!Price
 
|-
 
|-
 
|Storage Boxes
 
|Storage Boxes
 
!BX11
 
!BX11
−
|#301642||1||3.2||3.2
+
|[[#301642]]||1||3.2
−
|-
 
−
|rowspan="7"|Servers
 
−
!Server Auction
 
−
|#1736579||1||29.7||29.7
 
−
|-
 
−
!Primary IPv4
 
−
|Server #1736579||1||1.7||1.7
 
 
|-
 
|-
 +
|rowspan="5"|Servers
 
!Server Auction
 
!Server Auction
−
|#1777698||1||30.8||30.8
+
|[[#1736579]]||1||29.7
 
|-
 
|-
 
!Primary IPv4
 
!Primary IPv4
−
|Server #1777698||1||1.7||1.7
+
|(Attached to) server [[#1736579]]||1||1.7
 
|-
 
|-
 
!Server Auction
 
!Server Auction
−
|#1846134||1||38.5||38.5
+
|[[#1777698]]||1||30.8
 
|-
 
|-
 
!Primary IPv4
 
!Primary IPv4
−
|Server #1846134||1||1.7||1.7
+
|(Attached to) server [[#1777698]]||1||1.7
 
|-
 
|-
 
!Server Auction
 
!Server Auction
−
|#2109682||1||29||29
+
|[[#2109682]]||1||29
 
|-
 
|-
 
|vSwitches
 
|vSwitches
 
!Additional subnet /29
 
!Additional subnet /29
−
|vSwitch #31967||1||22||22
+
|vSwitch [[#31967]]||1||22
 
|-
 
|-
 
|rowspan="3"|Cloud Project "Default"
 
|rowspan="3"|Cloud Project "Default"
 
!IP
 
!IP
−
|1 IP, Billed monthly, Quantity type: Months||1||0.5||0.5
+
|1 IP, Billed monthly, Quantity type: Months||1||0.5
 
|-
 
|-
 
!Snapshot
 
!Snapshot
−
|1 Snapshot, Billed per GB per month, Quantity type: GB/Months||2.960176495||0.011||0.0326
+
|1 Snapshot, Billed per GB per month, Quantity type: GB/Months||2.960176495||0.0326
 
|-
 
|-
 
!Server cx11
 
!Server cx11
−
||1 Server, Billed monthly, Quantity type: Months||1||3.29||3.29
+
||1 Server, Billed monthly, Quantity type: Months||1||3.29
 
|}
 
|}
  
−
==Requirements==
+
==Assumptions==
 
Due to the lower cost, [[#The Metal]]'s rentals were purchased via [[#The Provider]]'s auction -- https://www.hetzner.com/sb?hdd_from=500&hdd_to=1000 -- based on the following assumptions.
 
Due to the lower cost, [[#The Metal]]'s rentals were purchased via [[#The Provider]]'s auction -- https://www.hetzner.com/sb?hdd_from=500&hdd_to=1000 -- based on the following assumptions.
  
Line 81: Line 78:
  
 
==The Metal==
 
==The Metal==
−
[[#The Habitat]] is deployed on three [[bare-metal server]]s and one [[storage box]]. As the result of [[#Choosing the metal]], [[#Node 1 hardware]], [[#Node 2 hardware]], [[#Node 3 hardware]], and [[#Storagebox hardware]] have been rented for that purpose.
+
[[#The Habitat]] is deployed on three [[bare-metal server]]s and one [[storage box]]. As the result of [[#Choosing the metal]], [[#1736579]], [[#1777698]], [[#2109682]], and [[#Storagebox hardware]] have been rented for that purpose.
  
 
===1736579===
 
===1736579===
Line 93: Line 90:
 
:* 1 x Primary IPv4
 
:* 1 x Primary IPv4
  
−
===Node 2 hardware===
+
===1777698===
 
:1 x Dedicated Root Server "Server Auction"
 
:1 x Dedicated Root Server "Server Auction"
 
:* Intel Xeon E3-1275v5
 
:* Intel Xeon E3-1275v5
Line 103: Line 100:
 
:* 1 x Primary IPv4
 
:* 1 x Primary IPv4
  
−
===Node 3 hardware===
+
===2109682===
 
:1 x Dedicated Root Server "Server Auction"
 
:1 x Dedicated Root Server "Server Auction"
 
:* Intel Xeon E3-1275v5
 
:* Intel Xeon E3-1275v5
Line 121: Line 118:
 
[[#The Farm]] cannot support [[high availability]] of the ''Bridges''. Resiliency of the ''Bridges'' is the courtesy of their owner, [[#The Provider]].
 
[[#The Farm]] cannot support [[high availability]] of the ''Bridges''. Resiliency of the ''Bridges'' is the courtesy of their owner, [[#The Provider]].
  
−
===External Bridge===
+
===301642===
 
: '''External''' ''Bridge'' serves as the hub for the public network, the [[Internet]]. It is located on external, public [[IPv4 address]] to provide for data transfer between [[#The Farm]]'s publicly-available and other Internet resources.
 
: '''External''' ''Bridge'' serves as the hub for the public network, the [[Internet]]. It is located on external, public [[IPv4 address]] to provide for data transfer between [[#The Farm]]'s publicly-available and other Internet resources.
  
Line 130: Line 127:
  
 
Сеть каждого ''Узла'' использует мост по выбираемой по умолчанию в [https://pve.proxmox.com/wiki/Network_Configuration#_default_configuration_using_a_bridge Network Configuration] модели.
 
Сеть каждого ''Узла'' использует мост по выбираемой по умолчанию в [https://pve.proxmox.com/wiki/Network_Configuration#_default_configuration_using_a_bridge Network Configuration] модели.
 +
 +
==Key terms==
 +
===The Infra===

Latest revision as of 14:03, 13 April 2024

Bureau Infrastructure (hereinafter, #The Infra) is the software and hardware that CNMCyber Team rents to host CNM Bureau Farm. The rented software and hardware consists of #The Metal and #The Bridges. Both are parts of Opplet Infrastructure.


In a nutshell

Needs to satisfy

In Opplet Infrastructure, #The Infra is the newest, most expensive part. It hosts the most critical pieces of Opplet's software such as Opplet.net, CNMCyber.com, and CNM Corp. To ensure high availability (HA) of the hosted software, it includes three bare-metal servers.

The Provider

For the purposes of this very wikipage, the Provider refers to Hetzner, which has been serving as #The Team's Internet service provider (ISP) and lessor of both #The Infra and Lab Infrastructure since 2016. Offers from other potential providers, specifically, Contabo and DigitalOcean, have been periodically reviewed, but no one else has offered any better quality/price rate on a long-term basis.

Costs

Category Product Description Quantity Price
Storage Boxes BX11 #301642 1 3.2
Servers Server Auction #1736579 1 29.7
Primary IPv4 (Attached to) server #1736579 1 1.7
Server Auction #1777698 1 30.8
Primary IPv4 (Attached to) server #1777698 1 1.7
Server Auction #2109682 1 29
vSwitches Additional subnet /29 vSwitch #31967 1 22
Cloud Project "Default" IP 1 IP, Billed monthly, Quantity type: Months 1 0.5
Snapshot 1 Snapshot, Billed per GB per month, Quantity type: GB/Months 2.960176495 0.0326
Server cx11 1 Server, Billed monthly, Quantity type: Months 1 3.29

Assumptions

Due to the lower cost, #The Metal's rentals were purchased via #The Provider's auction -- https://www.hetzner.com/sb?hdd_from=500&hdd_to=1000 -- based on the following assumptions.

Number of nodes

ProxmoxVE normally requires three nodes. The third node is needed to provide quorum; however, it shall not necessarily run applications. At the same time, Ceph's non-emergency operations require three nodes at least.

Hard drives

  1. The hard drive storage capacity for any of #The Nodes shall be 512Gb at least.
  2. Because Ceph is selected to power #The Storage, any hard-drive of #The Metal shall be both SSD and NVMe.

Processors

  1. The processor frequency for two Nodes of #The Metal shall be 32Gb at least. Processor frequency requirements to the third of #The Nodes may be lower because of ProxmoxVE's characteristics.
  2. Those servers that deploys Intel Xeon E3-1275v5 processors are preferable over those servers that deploys Intel Core i7-7700 ones.

Location

At least two Nodes shall be located in the same data center. Although #The Provider does not charge for internal traffic, this circumstance increases the speed of #The Farm as a whole. If no nodes are available in the same data center, they shall be looked for in the same geographic location.

The UI

With regards to #User interfaces (UIs), administrative access to #The Metal can be accomplished through several tools and portals that #The Provider grants to CNMCyber Customer.

GI

Its graphic interface belongs to #Dashboards.

CLI

For the purposes of this very wikipage, a command line refers to a command line interface (CLI) of any of #The COTS packages installed in #The Farm. This input-output line area allows #The Sysadmins and #The Superusers to interact with #The Cluster and #The Infrastructure rather than screen-based graphical buttons, icons, or hyperlinked texts in graphic user interfaces (GUIs).

The Metal

#The Habitat is deployed on three bare-metal servers and one storage box. As the result of #Choosing the metal, #1736579, #1777698, #2109682, and #Storagebox hardware have been rented for that purpose.

1736579

1 x Dedicated Root Server "Server Auction"
  • Intel Xeon E3-1275v5
  • 2x SSD M.2 NVMe 512 GB
  • 4x RAM 16384 MB DDR4 ECC
  • NIC 1 Gbit Intel I219-LM
  • Location: FSN1-DC1
  • Rescue system (English)
  • 1 x Primary IPv4

1777698

1 x Dedicated Root Server "Server Auction"
  • Intel Xeon E3-1275v5
  • 2x SSD M.2 NVMe 512 GB
  • 4x RAM 16384 MB DDR4 ECC
  • NIC 1 Gbit Intel I219-LM
  • Location: FSN1-DC1
  • Rescue system (English)
  • 1 x Primary IPv4

2109682

1 x Dedicated Root Server "Server Auction"
  • Intel Xeon E3-1275v5
  • 2x SSD M.2 NVMe 512 GB
  • 4x RAM 16384 MB DDR4 ECC
  • NIC 1 Gbit Intel I219-LM
  • Location: FSN1-DC1
  • Rescue system (English)

Storagebox hardware

The Bridges

Hetzner vSwitches (hereinafter, the Bridges) serve as bridges for #Communication channels to connect #The Nodes in networks and switch from one of #The Nodes to another. #The Cluster utilizes two Bridges, which are #Internal Bridge and #External Bridge.

#The Provider provides #The Team with the Bridges; They come with the lease of #The Metal. #The Team can order up to 5 connectors to be connected to one of #The Node's servers.

#The Farm cannot support high availability of the Bridges. Resiliency of the Bridges is the courtesy of their owner, #The Provider.

301642

External Bridge serves as the hub for the public network, the Internet. It is located on external, public IPv4 address to provide for data transfer between #The Farm's publicly-available and other Internet resources.

Сеть каждого Узла использует мост по выбираемой по умолчанию в Network Configuration модели.

Internal Bridge

Internal Bridge serves as the hub for node and storage networks. It is located on an internal, private IPv6 address to provide for data transfer between #The Nodes and their storage spaces.

Сеть каждого Узла использует мост по выбираемой по умолчанию в Network Configuration модели.

Key terms

The Infra

Retrieved from "https://wiki.cnmcyber.com/w/index.php?title=Bureau_Infrastructure&oldid=135082"