Logistics of Anime Tosho

This page provides a high level overview of the specifications, stats and costs with running Anime Tosho, for the curious minded. Details are accurate at time of writing in January 2021.

Servers and Setup

Anime Tosho runs on three servers: a processing/updates server, primary webserver and secondary webserver.

Updates Server

This server performs all the behind-the-scenes processing and content generation, including torrent downloads, uploads/mirroring content, screenshot extraction etc.

Stats
  • Average bandwidth usage in Dec 2020: 254GB in + 2,042GB out per day
  • Database size (on disk): 13.5GB (6.6GB shared + 6.9GB private)
Setup/Specs
  • Host: Online.net
  • Type: dedicated/"bare metal" server
  • CPU: Xeon E3 1231v3 (4 cores / 8 threads)
  • RAM: 32GB
  • Disk: 2x 2TB HDD (in mixed RAID modes across partitions)
  • Bandwidth: 300Mbps unmetered
  • OS: Debian amd64
  • Cost: €19.99/month

Many standard off-the-shelf tools are used during processing, however these are coordinated with completely custom scripts. Examples include:

  • Torrenting: Transmission
  • Scraping: custom script; CloudScraper used when necessary
  • Uploading to DDL hosts: custom script
  • Uploading to Usenet: ParPar, Nyuu
  • Series/episode tagging: custom script; AniDB used as source
  • Media file information: mediainfo, ffprobe, mkvmerge-identify
  • Screenshot handling: ffmpeg, VapourSynth
  • Subtitle extraction: mkvextract
  • Compression/archiving: 7zip, xz, cwebp
  • ...and a bunch of other tools I forgot to mention

Primary Webserver

This server serves the main website (animetosho.org). Updates are received from the updates server via database replication.

Stats
  • Average bandwidth usage in Dec 2020: 1.24GB in + 7.82GB out per day
  • Typical page requests: ~400k/day
  • Website database size (on disk): 151MB private + 4.5GB shared (updates)
Setup/Specs
  • Host: Veesp
  • Type: KVM virtual server
  • CPU: 1 vCore
  • RAM: 1GB
  • Disk: 25GB SSD
  • Bandwidth: 200Mbps unmetered
  • OS: Debian amd64
  • Cost: US$51/year

This server runs a nginx, MariaDB, PHP and Sphinxsearch setup to handle the website.

Secondary Webserver

This server serves everything the primary webserver doesn't, such as screenshots, RSS feeds and the mirror site. Updates are received from the updates server via database replication and lsync file synchronisation.

Stats
  • Average bandwidth usage in Dec 2020: 6.88GB in + 83.24GB out per day
  • Typical requests: ~1,200k/day (feed.animetosho.org) + ~25k/day (mirror.animetosho.org) + ~235k/day (storage.animetosho.org)
  • Storage files size: 352GB (257GB screenshots + 78GB attachments + 9GB NZBs + 8GB torrents)
Setup/Specs
  • Host: Online.net
  • Type: dedicated/"bare metal" server
  • CPU: Atom C2350 (2 cores)
  • RAM: 4GB
  • Disk: 1TB HDD
  • Bandwidth: 1Gbps?? unmetered
  • OS: Debian amd64
  • Cost: €65/year

As this server hosts a copy of the main website, it runs a similar setup, but also has some additional scripts for serving screenshots and attachments.

Costs

Server costs are listed above, which make up the bulk of the costs of running Anime Tosho. Currently, the only other recurring cost is the domain name registration (roughly US$13/year), which also includes DNS hosting, and Usenet accounts for uploading (cost varies/unpredictable). There have been more costs in the past, such as 1Fichier premium accounts and a server to specifically handle that.

ItemAnnual Cost
Updates Server€239.88
Primary Webserver$51
Secondary Webserver€65
Domain$13
Total$64 + €304.88

All up, costs total around $437/year or $36.42/month at time of writing, ignoring fees and forex expenses.

Note that Anime Tosho has no revenue stream, so all costs are paid out-of-pocket by the site admin.

beta
Anime DDL+NZB mirror
Current Time: 30/07/2021 09:34



About/FAQs