Grid Stats - New Nodes & Utilization Overview

ThreeFold Grid Utilization
, ,
61

New Active Nodes, June 12 – 19

Total new: 18

  • Belgium: 1
  • Ukraine: 7
  • United States: 1
  • Netherlands: 3
  • Vietnam: 1
  • Austria: 3
  • Germany: 1
  • Australia: 1

Total Capacity

Online nodes: 2356,
Sleeping nodes: 335
Total nodes: 2691

Change
Cores 64,463 4.25%
RAM 413,743 GB 3.13%
SSD 9,656,959 GB 1.33%
HDD 29,428,663 GB 9.26%
Uptime greater than # of Nodes % of active nodes
1 Week 1,926 72%
1 Month 1,189 44%
3 Months 728 27%
6 Months 453 17%
9 Months 289 11%
1 Year 139 5%

Utilization

Mainnet Utilization
Cores 2,111 / 63,697 (3.31%)
RAM 3,129 / 408,420 GB (0.77%)
SSD 53,041 / 9,640,645 GB (0.55%)
HDD 1,074 / 29,176,613 GB (0.0%)

Testnet Utilization
Cores 87 / 766 (11.36%)
RAM 270 / 5,323 GB (5.07%)
SSD 2,924 / 16,313 GB (17.93%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization
Cores 2,198 / 64,463 (3.41%)
RAM 3,399 / 413,743 GB (0.82%)
SSD 55,965 / 9,656,959 GB (0.58%)
HDD 1,074 / 29,428,663 GB (0.0%)
3 Likes
62

New Active Nodes, June 19 – 26

Total new: 26

  • Egypt: 1
  • Belgium: 1
  • Australia: 10
  • Germany: 5
  • Vietnam: 2
  • Netherlands: 4
  • United States: 1
  • Switzerland: 2

Total Capacity

Online nodes: 2357
Sleeping nodes: 354
Total nodes: 2711

Change
Cores 64,810 0.54%
RAM 417,885 GB 1.0%
SSD 9,696,110 GB 0.41%
HDD 29,407,880 GB -0.07%

Utilization

Mainnet Utilization
Cores 2,009 / 64,046 (3.14%)
RAM 3,154 / 412,576 GB (0.76%)
SSD 54,994 / 9,679,706 GB (0.57%)
HDD 1,160 / 29,155,831 GB (0.0%)

Testnet Utilization
Cores 115 / 764 (15.05%)
RAM 279 / 5,309 GB (5.25%)
SSD 2,959 / 16,404 GB (18.04%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization
Cores 2,124 / 64,810 (3.28%)
RAM 3,432 / 417,885 GB (0.82%)
SSD 57,953 / 9,696,110 GB (0.6%)
HDD 1,160 / 29,407,880 GB (0.004%)
2 Likes
63

New Active Nodes, June 26 – July 3

Total new: 5

  • Ukraine: 1
  • United States: 3
  • Vietnam: 1

Total Capacity

Online nodes: 2317
Sleeping nodes: 402
Total nodes: 2719

Change
Cores 66,814 3.09%
RAM 432,972 GB 3.61%
SSD 9,873,033 GB 1.82%
HDD 29,341,377 GB -0.23%

Utilization

Mainnet Utilization
Cores 2,048 / 66,048 (3.1%)
RAM 3,247 / 427,655 GB (0.76%)
SSD 78,040 / 9,856,570 GB (0.79%)
HDD 1,160 / 29,089,327 GB (0.0%)

Testnet Utilization
Cores 96 / 766 (12.53%)
RAM 288 / 5,318 GB (5.42%)
SSD 2,994 / 16,463 GB (18.19%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization
Cores 2,144 / 66,814 (3.21%)
RAM 3,535 / 432,972 GB (0.82%)
SSD 81,034 / 9,873,033 GB (0.82%)
HDD 1,160 / 29,341,377 GB (0.004%)
3 Likes
64

5 news nodes but 2,000 additional cores over last week?

65

Yeah, I raised an eyebrow at this initially too. “New” nodes are node IDs that were created during the week that the report is for. So nodes that were created earlier, were taken down, then became active again are not included in this figure.

That said, there are still only 8 more nodes in the active set than the week before. This points to the fact that in any given week, there are a significant number of nodes that become inactive, and therefore the actual churn in nodes is not reflected in these figures.

So the conclusion is that last week, a number of high capacity nodes rejoined the network with existing node IDs. Simultaneously, an approximately equal number of lower capacity nodes became inactive. I estimate the churn was around 80 nodes, so that’s an average difference of 25 cores between nodes in the first group and nodes in the second group to give a total difference of 2000.

I want to return to the question of node churn and try to understand better what’s happening. Are these mostly nodes that join the network for a short time and then disappear? Or are they nodes that stick around but consistently go down for a week or more at a time? And to the extent that it’s the latter, why?

One final note I’ll make here is that I don’t attempt to account for the fact that nodes can rejoin the network with a new node ID after the disks are wiped. My assumption is that it’s a small number, but in a week where 5 new node IDs are registered, even a single case would be 20%.

66

I’d like to think that’s older hardware being replaced by newer at a healthy pace :slight_smile:

1 Like
67

New Active Nodes, July 3 – July 10

Total new: 16

  • Egypt: 4
  • Netherlands: 5
  • Poland: 1
  • Canada: 1
  • United States: 1
  • Germany: 1
  • Belgium: 2
  • Vietnam: 1

Total Capacity

Online nodes: 2290
Sleeping nodes: 397
Total nodes: 2687

Change
Cores 66,740 -0.11%
RAM 433,217 GB 0.06%
SSD 9,830,097 GB -0.43%
HDD 28,934,236 GB -1.39%

Utilization

Mainnet Utilization
Cores 2,011 / 65,980 (3.05%)
RAM 3,088 / 427,897 GB (0.72%)
SSD 67,884 / 9,813,943 GB (0.69%)
HDD 1,160 / 28,680,185 GB (0.0%)

Testnet Utilization
Cores 95 / 760 (12.5%)
RAM 287 / 5,320 GB (5.4%)
SSD 2,976 / 16,154 GB (18.42%)
HDD 0 / 254,050 GB (0.0%)

Total Utilization
Cores 2,106 / 66,740 (3.16%)
RAM 3,375 / 433,217 GB (0.78%)
SSD 70,860 / 9,830,097 GB (0.72%)
HDD 1,160 / 28,934,236 GB (0.0%)
1 Like
68

New Active Nodes, July 10 – July 17

Total new: 12

  • Netherlands: 5
  • United States: 1
  • Portugal: 1
  • United Kingdom: 5

Total Capacity

Online nodes: 2229
Sleeping nodes: 405
Total nodes: 2634

Change
Cores 65,486 -1.88%
RAM 423,948 GB -2.14%
SSD 9,632,995 GB -2.01%
HDD 28,624,493 GB -1.07%

Utilization

Mainnet Utilization
Cores 1,979 / 64,734 (3.06%)
RAM 3,038 / 418,659 GB (0.73%)
SSD 67,351 / 9,617,234 GB (0.7%)
HDD 1,160 / 28,374,444 GB (0.0%)

Testnet Utilization
Cores 94 / 752 (12.5%)
RAM 287 / 5,289 GB (5.42%)
SSD 2,959 / 15,761 GB (18.77%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 2,073 / 65,486 (3.17%)
RAM 3,324 / 423,948 GB (0.78%)
SSD 70,310 / 9,632,995 GB (0.73%)
HDD 1,160 / 28,624,493 GB (0.0%)
1 Like
69

New Active Nodes, July 23 – July 31

Total new: 9

  • Netherlands: 2
  • United States: 3
  • United Kingdom: 1
  • France: 1
  • Vietnam: 1
  • Germany: 1

Total Capacity

Online nodes: 2241
Sleeping nodes: 393
Total nodes: 2598

Change
Cores 63,710 -2.71%
RAM 412,114 GB -2.79%
SSD 9,400,455 GB -2.41%
HDD 28,691,216 GB 0.23%

Utilization

Mainnet Utilization
Cores 2,017 / 62,985 (3.2%)
RAM 3,119 / 406,907 GB (0.77%)
SSD 67,976 / 9,388,744 GB (0.72%)
HDD 1,160 / 28,443,167 GB (0.0%)

Testnet Utilization
Cores 99 / 749 (13.22%)
RAM 296 / 5,285 GB (5.61%)
SSD 3,177 / 15,759 GB (20.16%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 2,116 / 63,734 (3.32%)
RAM 3,415 / 412,192 GB (0.83%)
SSD 71,152 / 9,404,504 GB (0.76%)
HDD 1,160 / 28,693,217 GB (0.0%)
1 Like
70

New Active Nodes, July 31 – August 7

Total new: 13

  • Ukraine: 1
  • United Kingdom: 3
  • Australia: 1
  • Philippines: 2
  • United States: 3
  • Vietnam: 1
  • Netherlands: 1
  • Germany: 1

Total Capacity

Online nodes: 2153
Sleeping nodes: 414
Total nodes: 2567

Change
Cores 63,520 -0.3%
RAM 410,161 GB -0.47%
SSD 9,493,384 GB 0.99%
HDD 28,624,083 GB -0.23%

Utilization

Mainnet Utilization
Cores 2,024 / 62,771 (3.22%)
RAM 3,145 / 404,876 GB (0.78%)
SSD 67,645 / 9,477,625 GB (0.71%)
HDD 1,160 / 28,374,034 GB (0.0%)

Testnet Utilization
Cores 75 / 749 (10.01%)
RAM 219 / 5,285 GB (4.14%)
SSD 2,519 / 15,759 GB (15.99%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 2,099 / 63,520 (3.3%)
RAM 3,364 / 410,161 GB (0.82%)
SSD 70,165 / 9,493,384 GB (0.74%)
HDD 1,160 / 28,624,083 GB (0.0%)
1 Like
71

Bit late… but actually it were 31 nodes (88 threads each) removed from DC begin June, given a fresh node id/farm and put back up again.

72

That would explain the big spike in “new nodes” there :slight_smile:

This got me thinking (again) about ways to improve detection of which nodes are actually coming and going from the grid. One relatively simple but imperfect way would be to try matching node stats, since these are relatively unique when comparing at full precision (aside from core count). Another approach would be querying the DMI information from the nodes on a regular basis and matching that.

73

New Active Nodes, August 7 – 14

Total new: 8

  • United States: 4
  • Belgium: 1
  • Egypt: 1
  • Netherlands: 1
  • United Kingdom: 1

Total Capacity

Online nodes: 2081
Sleeping nodes: 441
Total nodes: 2522

Change
Cores 61,354 -3.41%
RAM 399,382 GB -2.63%
SSD 9,389,552 GB -1.09%
HDD 28,762,672 GB 0.48%

Utilization

Mainnet Utilization
Cores 1,952 / 60,602 (3.22%)
RAM 3,084 / 394,092 GB (0.78%)
SSD 67,384 / 9,373,791 GB (0.72%)
HDD 1,160 / 28,512,622 GB (0.0%)

Testnet Utilization
Cores 76 / 752 (10.11%)
RAM 221 / 5,289 GB (4.18%)
SSD 2,529 / 15,761 GB (16.04%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 2,028 / 61,354 (3.31%)
RAM 3,305 / 399,382 GB (0.83%)
SSD 69,913 / 9,389,552 GB (0.74%)
HDD 1,160 / 28,762,672 GB (0.0%)
74

New Active Nodes, August 14 – 21

Total new: 10

  • Belgium: 3
  • Egypt: 1
  • United Kingdom: 2
  • Vietnam: 2
  • Netherlands: 1
  • Germany: 1

Total Capacity

Online nodes: 2038
Sleeping nodes: 524
Total nodes: 2562

Change
Cores 62,419 1.74%
RAM 402,100 GB 0.68%
SSD 9,445,009 GB 0.59%
HDD 28,733,212 GB -0.1%

Utilization

Mainnet Utilization
Cores 1,938 / 61,667 (3.14%)
RAM 3,085 / 396,811 GB (0.78%)
SSD 67,275 / 9,429,247 GB (0.71%)
HDD 1,160 / 28,483,163 GB (0.0%)

Testnet Utilization
Cores 79 / 752 (10.51%)
RAM 223 / 5,289 GB (4.21%)
SSD 2,737 / 15,761 GB (17.37%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 2,017 / 62,419 (3.23%)
RAM 3,308 / 402,100 GB (0.82%)
SSD 70,012 / 9,445,009 GB (0.74%)
HDD 1,160 / 28,733,212 GB (0.0%)
1 Like
75

New Active Nodes, August 21 – 28

Total new: 4

  • Egypt: 3
  • Netherlands: 1

Total Capacity

Online nodes: 1921
Sleeping nodes: 492
Total nodes: 2413

Change
Cores 58,827 -5.75%
RAM 383,735 GB -4.57%
SSD 9,019,002 GB -4.51%
HDD 27,559,987 GB -4.08%

Utilization

Mainnet Utilization
Cores 1,909 / 58,075 (3.29%)
RAM 3,069 / 378,446 GB (0.81%)
SSD 67,218 / 9,002,240 GB (0.75%)
HDD 1,160 / 27,309,937 GB (0.0%)

Testnet Utilization
Cores 77 / 752 (10.24%)
RAM 220 / 5,289 GB (4.16%)
SSD 2,597 / 16,762 GB (15.49%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 1,986 / 58,827 (3.38%)
RAM 3,289 / 383,735 GB (0.86%)
SSD 69,815 / 9,019,002 GB (0.77%)
HDD 1,160 / 27,559,987 GB (0.0%)
76

New Active Nodes, August 28 – September 4

Total active 2446
Total new: 10

  • Egypt: 4
  • Ukraine: 2
  • United States: 3
  • Vietnam: 1

Total Capacity

Online nodes: 1937
Sleeping nodes: 479
Total nodes: 2446

Change
Cores 60,120 2.2%
RAM 387,533 GB 0.99%
SSD 8,931,837 GB -0.97%
HDD 27,347,372 GB -0.77%

Utilization

Mainnet Utilization
Cores 1,931 / 59,336 (3.25%)
RAM 3,106 / 382,213 GB (0.81%)
SSD 67,305 / 8,914,671 GB (0.75%)
HDD 1,160 / 27,097,322 GB (0.0%)

Testnet Utilization
Cores 78 / 784 (9.95%)
RAM 225 / 5,320 GB (4.23%)
SSD 2,666 / 17,166 GB (15.53%)
HDD 0 / 250,049 GB (0.0%)

Total Utilization
Cores 2,009 / 60,120 (3.34%)
RAM 3,331 / 387,533 GB (0.86%)
SSD 69,971 / 8,931,837 GB (0.78%)
HDD 1,160 / 27,347,372 GB (0.0%)
1 Like
77

New Active Nodes, September 11 – 18

Total new: 18

  • Belgium: 4
  • United States: 4
  • United Kingdom: 1
  • Vietnam: 1
  • Netherlands: 6
  • Germany: 2

Total Capacity

Online nodes: 1868
Sleeping nodes: 493
Total nodes: 2361

Change
Cores 58,645 -2.45%
RAM 382,039 GB -1.42%
SSD 8,932,690 GB 0.01%
HDD 26,905,927 GB -1.61%

Utilization

Mainnet Utilization
Cores 1,888 / 57,849 (3.26%)
RAM 3,056 / 376,676 GB (0.81%)
SSD 66,710 / 8,915,461 GB (0.75%)
HDD 1,160 / 26,649,876 GB (0.0%)

Testnet Utilization
Cores 80 / 796 (10.05%)
RAM 229 / 5,363 GB (4.27%)
SSD 2,754 / 17,228 GB (15.99%)
HDD 0 / 256,051 GB (0.0%)

Total Utilization
Cores 1,968 / 58,645 (3.36%)
RAM 3,285 / 382,039 GB (0.86%)
SSD 69,465 / 8,932,690 GB (0.78%)
HDD 1,160 / 26,905,927 GB (0.0%)
78

New Active Nodes, September 18 – 25

Total new: 3

  • Poland: 1
  • United States: 1
  • Vietnam: 1

Total Capacity

Online nodes: 1854
Sleeping nodes: 475
Total nodes: 2329

Change
Cores 58,142 -0.86%
RAM 379,485 GB -0.67%
SSD 8,860,513 GB -0.81%
HDD 26,654,273 GB -0.94%

Utilization

Mainnet Utilization
Cores 2,020 / 57,386 (3.52%)
RAM 3,152 / 374,181 GB (0.84%)
SSD 67,442 / 8,843,731 GB (0.76%)
HDD 1,160 / 26,402,223 GB (0.0%)

Testnet Utilization
Cores 78 / 756 (10.32%)
RAM 225 / 5,304 GB (4.24%)
SSD 2,709 / 16,782 GB (16.14%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization
Cores 2,098 / 58,142 (3.61%)
RAM 3,377 / 379,485 GB (0.89%)
SSD 70,151 / 8,860,513 GB (0.79%)
HDD 1,160 / 26,654,273 GB (0.0%)
79

New Active Nodes, September 25 – October 2

Total active 2305
Total new: 4

  • United States: 1
  • Poland: 1
  • Vietnam: 2

Total Capacity

Online nodes: 1826
Sleeping nodes: 479
Total nodes: 2305

Change
Cores 56,480 -2.86%
RAM 368,531 GB -2.89%
SSD 8,701,631 GB -1.79%
HDD 26,268,764 GB -1.45%

Utilization

Mainnet Utilization
Cores 2,015 / 55,725 (3.62%)
RAM 3,147 / 363,229 GB (0.87%)
SSD 67,624 / 8,684,918 GB (0.78%)
HDD 1,160 / 26,016,714 GB (0.0%)

Testnet Utilization
Cores 78 / 755 (10.33%)
RAM 224 / 5,302 GB (4.22%)
SSD 2,658 / 16,713 GB (15.9%)
HDD 0 / 252,050 GB (0.0%)

Total Utilization
Cores 2,093 / 56,480 (3.71%)
RAM 3,371 / 368,531 GB (0.91%)
SSD 70,282 / 8,701,631 GB (0.81%)
HDD 1,160 / 26,268,764 GB (0.0%)
80

New Active Nodes, October 2 – 9

Total new: 10

  • Egypt: 1
  • Germany: 1
  • United States: 1
  • Vietnam: 1
  • Netherlands: 6

Total Capacity

Online nodes: 1844
Sleeping nodes: 476
Total nodes: 2311

Change
Cores 56,449 -0.05%
RAM 368,372 GB -0.04%
SSD 8,676,004 GB -0.29%
HDD 26,380,423 GB 0.43%

Utilization

Mainnet Utilization
Cores 1,966 / 55,718 (3.53%)
RAM 3,109 / 363,259 GB (0.86%)
SSD 67,031 / 8,659,554 GB (0.77%)
HDD 1,160 / 26,139,375 GB (0.0%)

Testnet Utilization
Cores 78 / 731 (10.67%)
RAM 224 / 5,113 GB (4.37%)
SSD 2,658 / 16,451 GB (16.16%)
HDD 0 / 241,048 GB (0.0%)

Total Utilization
Cores 2,044 / 56,449 (3.62%)
RAM 3,333 / 368,372 GB (0.9%)
SSD 69,689 / 8,676,004 GB (0.8%)
HDD 1,160 / 26,380,423 GB (0.0%)