Jump to content

File:Infrastructure overview.png

From Wikitech

Original file (1,053 × 1,261 pixels, file size: 245 KB, MIME type: image/png)

Summary

Very high level description of the Wikimedia Infrastructure up to January 2019. This graph has been created using draw.io, the xml source is available in phab:P8006 (previously history)

Licensing

I, the copyright holder of this work, hereby publish it under the following licenses:
GNU head Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the section entitled GNU Free Documentation License.

w:en:Creative Commons
attribution share alike
This file is licensed under the Creative Commons Attribution-Share Alike 3.0 Unported, 2.5 Generic, 2.0 Generic and 1.0 Generic license.
You are free:
  • to share: to copy, distribute and transmit the work
  • to remix: to adapt the work

Under the following conditions:
  • attribution: You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
  • share alike: If you remix, transform, or build upon the material, you must distribute your contributions under the same or compatible license as the original.
You may select the license of your choice.

File history

Click on a date/time to view the file as it appeared at that time.

Date/TimeThumbnailDimensionsUserComment
current14:31, 29 October 2019Thumbnail for version as of 14:31, 29 October 20191,053 × 1,261 (245 KB)Ema (talk | contribs)Cache backends connect directly to the application servers now that they've been upgraded to ATS. Update the diagram accordingly. Source here: https://phabricator.wikimedia.org/P9495
16:30, 27 October 2019Thumbnail for version as of 16:30, 27 October 20191,053 × 1,261 (173 KB)Jforrester (talk | contribs)Update comment to note we now use Zend, not HHVM, for PHP.
18:18, 25 October 2019Thumbnail for version as of 18:18, 25 October 20191,056 × 1,221 (252 KB)Aklapper (talk | contribs)Update cache nodes: NGINX and one Varnish layer getting replaced by ATS (see phab:T227432 etc). Thanks to User:Ema for input. This graph has been created using draw.io, the xml source is available in https://phabricator.wikimedia.org/P8006
13:25, 18 January 2019Thumbnail for version as of 13:25, 18 January 20191,055 × 1,220 (214 KB)Aklapper (talk | contribs)...and fix Hadoop to AQS arrow
13:11, 18 January 2019Thumbnail for version as of 13:11, 18 January 20191,055 × 1,220 (214 KB)Aklapper (talk | contribs)Add ORES, WDQS, Kubernetes; rename PageView API to AQS; mention node.js. Co-author: User:Ladsgroup. This graph has been created using draw.io, the xml source is available in https://phabricator.wikimedia.org/P8006
15:01, 10 January 2019Thumbnail for version as of 15:01, 10 January 20191,055 × 1,220 (196 KB)Aklapper (talk | contribs)No content changes, just making space for more stuff to add after LVS
14:29, 10 January 2019Thumbnail for version as of 14:29, 10 January 20191,063 × 1,220 (196 KB)Aklapper (talk | contribs)Event Logging also uses Hadoop, not only MariaDB
22:58, 3 January 2019Thumbnail for version as of 22:58, 3 January 20191,063 × 1,220 (192 KB)Aklapper (talk | contribs)fix missing ES arrow pointer
22:56, 3 January 2019Thumbnail for version as of 22:56, 3 January 20191,063 × 1,220 (189 KB)Aklapper (talk | contribs)Add CXServer to Citoid/Mathoid box; simplify arrows.
22:13, 3 January 2019Thumbnail for version as of 22:13, 3 January 20191,063 × 1,220 (188 KB)Aklapper (talk | contribs)Add eqsin. This graph has been created using draw.io, the xml source is available in https://phabricator.wikimedia.org/P7959
11:16, 2 January 2019Thumbnail for version as of 11:16, 2 January 20191,103 × 1,220 (193 KB)Aklapper (talk | contribs)Replace Mysql with MariaDB; HHVM to be replaced by Zend; simplify some arrows. This graph has been created using draw.io, the xml source is available in https://phabricator.wikimedia.org/P7947
12:42, 5 September 2016Thumbnail for version as of 12:42, 5 September 20161,136 × 1,220 (198 KB)Elukey (talk | contribs)
12:41, 5 September 2016Thumbnail for version as of 12:41, 5 September 20161,136 × 1,220 (198 KB)Elukey (talk | contribs)Improved Varnish layer, improved analytics part (hadoop - varnishkafka - kafka - pageviews), added ChangeProp and the Kafka main clusters, added parser cache
16:05, 18 January 2016Thumbnail for version as of 16:05, 18 January 20163,189 × 3,159 (754 KB)Elukey (talk | contribs)codfw is in Dallas, not Austin :)
15:09, 18 January 2016Thumbnail for version as of 15:09, 18 January 20163,225 × 3,159 (817 KB)Elukey (talk | contribs)Added more info about EventLoggin, Kafka and Hadoop
10:59, 18 January 2016Thumbnail for version as of 10:59, 18 January 20163,189 × 3,159 (755 KB)Elukey (talk | contribs)Missing arrow to SF
10:55, 18 January 2016Thumbnail for version as of 10:55, 18 January 20163,189 × 3,159 (754 KB)Elukey (talk | contribs)eqiad mispelled in a label
10:53, 18 January 2016Thumbnail for version as of 10:53, 18 January 20163,189 × 3,159 (754 KB)Elukey (talk | contribs)Corrected Austin, added some labels for LVS, added some suggestions
00:25, 16 January 2016Thumbnail for version as of 00:25, 16 January 20163,189 × 3,159 (690 KB)Elukey (talk | contribs)Updated Varnish layer
23:48, 15 January 2016Thumbnail for version as of 23:48, 15 January 20163,144 × 3,159 (679 KB)Elukey (talk | contribs)Very high level description of the Wikimedia Infrastructure (draft)

The following page uses this file: