PSF Infrastructure Overview =========================== The PSF runs a wide variety of infrastructure services to support its mission from the `PyCon site `_ to the `CPython Mercurial server `_. The goal of this page is to enumerate all these services, where they run, and who the main contact points are. The Infrastructure Team ----------------------- The infrastructure team is ultimately responsible for maintaining PSF infrastructure. It is not, however, required to be a member of the infrastructure to run a PSF service. Indeed, the day to day operations of most services are handled by people not on the infrastructure team. The infrastructure team can assist in setting up new services and advise maintainers of individual services. Its members also generally handle changes to sensitive global systems such as DNS. The current team members are: * Alex Gaynor (has no responsibilities) * Benjamin Peterson * Benjamin W. Smith * Donald Stufft * Ee Durbin (PSF Director of Infrastructure) * Jacob Coffee (PSF Infrastructure Engineer) * Noah Kantrowitz The best way to contact the infrastructure team is mailing infrastructure-staff@python.org. There's also often people hanging out on the #python-infra channel of `Libera `_. Infrastructure Providers ------------------------ The PSF uses several different cloud providers and services for its infrastructure. Fastly `Fastly `_ generously donates its content distribution network (CDN) to the PSF. Our highest traffic services (i.e. PyPI, www.python.org, docs.python.org) use this CDN to improve end-user latency. DigitalOcean `DigitalOcean `_ is the current primary hosting for most of the infrastructure, services deployed here are managed by `Salt `_. Heroku `Heroku `_ hosts many of the CPython core workflow bots, ephemeral or proof of concept apps, as well as other web apps that are well suited to it's platform. Gandi `Gandi `_ is our domain registar Amazon Route 53 `Amazon Route 53 `_ hosts DNS for all domains. It is currently manually managed by Infrastructure Staff. DataDog `DataDog `_ provides metrics, dashboards, and alerts. Pingdom `Pingdom `_ provides monitoring and complains to us when services are down. PagerDuty `PagerDuty `_ is used for on-call rotation for PSF Infrastructure employees on the front-line, and volunteers as backup. OSUOSL `Oregon State University Open Source Lab `_ hosts one hardware server for the PSF, used by speed.python.org for running benchmarks This host was provisioned using `Chef `_ and their configuration management is in the `psf-chef git repo `_. Datacenters ----------- ====== ============= ====== PSF DC Provider Region ====== ============= ====== ams1 Digital Ocean AMS3 nyc1 Digital Ocean NYC3 sfo1 Digital Ocean SFO2 ====== ============= ====== Details of Various Services --------------------------- This section enumerates PSF services, generalities about their hosting, and contact information for the owners. Buildbot The `buildbot master `_ is a service run by python-dev@python.org, particularly Antoine Pitrou and Zach Ware. bugs.python.org bugs.python.org is hosted by the PSF on DigitalOcean, powered by Roundup. It also hosts bugs.jython.org and issues.roundup-tracker.org. docs.python.org The Python documentation is hosted on DigitalOcean, served through Fastly, and owned by Julien Palard. hg.python.org The CPython Mercurial repositories are hosted on a Digital Ocean VM. The service is owned by Antoine Pitrou and Georg Brandl. mail.python.org The python.org `Mailman `_ instance is hosted on https://mail.python.org as well as SMTP (Postfix). All inquiries should be directed to postmaster@python.org. planetpython.org and planet.jython.org These are hosted on a DigitalOcean VM. The Planet code and configuration are `hosted on GitHub `_ and maintained by the team at planet@python.org. pythontest.net `pythontest.net `_ hosts services and files used by the Python test suite. python-dev@python.org is ultimately responsible for its maintenance. speed.python.org speed.python.org is a `Codespeed `_ `instance `_ tracking Python performance. The web interface is hosted on a DigitalOcean VM, benchmarks are run on a beefy machine at OSUOSL and scheduled by the Buildbot master. Maintained by speed@python.org and Zach Ware. wiki.python.org This is hosted on an DigitalOcean VM. Marc-André Lemburg owns it. www.jython.org This is hosted from an Amazon S3 Bucket. The setup is quite simple and shouldn't require much tweaking, but Infrastructure Staff can be poked about it. www.python.org The `main Python website `_ is a Django app hosted on Heroku. Its source code is available on `GitHub `_, and issues with the site can be reported to the `GitHub issue tracker `_. Python downloads (i.e. everything under https://www.python.org/ftp/) are hosted on a separate DigitalOcean VM. The whole site is behind Fastly. There is also https://staging.python.org for testing the site. http://legacy.python.org is the old website hosted from a static mirror. PyCon The PyCon website is hosted on Heroku. The contact address is pycon-site@python.org. PyPI The `Python Package Index `_ sees the most load of any PSF service. Its source code is available `on GitHub `_. All of its infrastructure runs on AWS configured by `pypi-infra `_, and it is fronted by Fastly. The infrastructure is maintained by Ee Durbin, Donald Stufft, and Dustin Ingram. The contact address is admin@pypi.org. PyPy properties The `PyPy website `_ is hosted on a DigitalOcean VM and maintained by pypy-dev@python.org.