Lorenzo Alberton

London, UK   ·   Contact me   ·  

Portfolio » DataSift

https://datasift.com     Social Media, Analytics, Advertising

DataSift DataSift offers the most powerful and sophisticated tools for extracting value from Social Data and real-time news. The amount of content that Internet users are creating and sharing through Social Media is exploding. DataSift offers the best tools for collecting, filtering and analyzing this data. DataSift's platform has been built specifically to process large volumes of structured and unstructured data and derive value from it.

I joined the startup at its very early stages, introducing solid development, QA, deployment, communication and monitoring processes, transforming and growing the engineering department and its practices. I designed and implemented many critical components of the platform, radically improving the data flow within the pipeline (from 40+ seconds of end-to-end latency to sub-200 milliseconds), integrated with new data sources, designed scalable delivery systems and improved performances, resilience and monitoring across the board. The platform's architecture has been covered on High Scalability and other main sites.


Back

Card image cap
DataSift  
  • Technologies: Go, PHP, Java/Scala, C++, ZeroMQ, Kafka, MySQL, HBase, RocksDB, Cassandra, Hadoop, ElasticSearch, Varnish, GoCD, RPM, OpenStack
  • Year: 2010-2019
  • Employer: DataSift