https://blog.step.com/2016/04/08/an-open-source-project-for-tech-salaries/
Monthly Archives: December 2016
Big Data Engineer
Big Data Engineer
2016 salary range: $129,500 to $183,500
2017 salary range: $135,000 to $196,000
Projected salary growth: 5.8%
These pros design and implement solutions for big data challenges. They gather business objectives from users and data scientists, and then they translate those objectives into data-processing workflows. They should have a strong knowledge of statistics, programming experience in Python or Java, and the ability to design and implement big data solutions. Experience with NoSQL is preferred. They should also have experience with data mining, processing large amounts of raw data, and maintaining relational databases for storage and data acquisition. These pros typically hold a bachelor’s degree in a related field and have from four to six years of experience.
AI
Yann LeCun
Geoffrey Hinton
Yoshua Bengio
Andrew Ng
Research papers that changed the world of Big Data
CFS – complete fair scheduler
C++ big data
1. map reduce
thrill(http://project-thrill.org)
hce (hadoop C++ extension)
google mr4c(https://github.com/google/mr4c)
2. fs
qfs (https://github.com/quantcast/qfs)
3. big table
hypertable (http://www.hypertable.org)
知识体系
1. C++
C++ Primer, Fifth Edition
2. Design pattern
Design Patterns Elements of Reusable Object-Oriented Software
3. multi-thread
c++ concurrency in action: practical multithreading
4. distributed algorithm
Distributed Systems An Algorithmic Approach
5. parallel algorithm
Introduction to Parallel Computing, Second Edition