[Hamara-users] Technologies/Platforms of big giants (Google, Facebook, Whatsapp, Flickr, Instagram, Youtube etc.)

[sahil साहिल]

Namaste Friends,

As you might know I have asked in my previous email regarding the
technologies which big tech giants are using or may use to spin up their
servers and process scores of data.

So I was doing research on this since long on how do they (Google,
Facebook, Instagram, Amazon, Flickr etc.) manage their technologies/servers
and process scores of data as I am very much curious to know about how do
they do it. This is what I found in my research about their technologies
and their platforms.

All I got to know this from google, wired, and various other tech related
blogs.

OS: Linux (RedHat/Ubuntu/SuSe), FreeBSD
EC2 instances for various purposes (Extra-Large machines with SSD and
Multi-core CPU's with 100+ RAM)
Amazon’s Elastic Load Balancer (EBS is deployed in a software RAID
configuration) and Amazon’s Route53 for the DNS
Amazon CloudFront as the CDN
Amazon S3 (for storage)
Webserver: Apache/Ngnix/Lihttpd
Memcache: for caching
Database: Redis(majority), MySQL, PostgreSQL (master-replica setup) {DB
runs on Quadruple Extra-Large Memory instances and entirely on separate
instances}
ImageMagick, for image processing (Flickr)
Ganglia for distributed system monitoring (Flickr)
Monitoring: Nagios, Munin, ServerDensity
Version Control System: Git (almost used by all), Cvsup (Flickr)
Perl & CPAN (Flickr, DuckDuckGo), Python (Youtube, Instagram, Google),
Java, C++, jScript, Jboss, Servelts
Sentry for Python error reporting
Gunicorn as their WSGI server (Instagram)
Erlang (Whatsapp) and Custom XMPP and SQLite
Fabric is used to execute commands in parallel on all machines (Instagram)
Distributed Systems Infrastructure: GFS, MapReduce, BigTable (Google)

Kindly share your thoughts and views on the same. And, if I have missed
something then please add.

Look forward to hear from you.

Thank you.

-- 

*Regards,Sahil ModGill*
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
This
email has been sent from a virus-free computer protected by Avast.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DDB4FAA8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.hamaralinux.org/pipermail/hamara-users/attachments/20160121/d3658334/attachment.html>