YouTube Link - https://youtu.be/B4bVJ_U6CmE ** Big Data Masters Training Program: https://www.edureka.co/masters-program/big-data-architect-training ** This Edureka PPT on "Big Data Engineer Skills" will tell you the required skill sets to become a Big Data Engineer. It includes the following topics: Who is a Big Data Engineer? Big Data Engineer Responsibilities Big Data Engineer Skills How to acquire those skills? Follow us to never miss an update in the future. YouTube: https://www.youtube.com/user/edurekaIN Instagram: https://www.instagram.com/edureka_learning/ Facebook: https://www.facebook.com/edurekaIN/ Twitter: https://twitter.com/edurekain LinkedIn: https://www.linkedin.com/company/edureka

1. Copyright © 2017, edureka and/or its affiliates. All rights reserved.

2. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Agenda
Who is a Big Data Engineer
Big Data Engineer Responsibilities
Big Data Engineer Skills
How to Acquire Required Skills

3. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Who is a Big Data Engineer?

4. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer
Data Engineers are the ones who
the complete architecture of the large-scale processing system.
Designs Constructs Tests
Maintains
Maintains

5. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
What are the responsibilities of a Big Data Engineer?

6. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Job Description
B i g D a t a
E n g i n e e r

7. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Job Description
B i g D a t a
E n g i n e e r

8. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Job Description
B i g D a t a
E n g i n e e r

9. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer – Job Responsibilities

10. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer Responsibilities
Design, Develop, Construct, Install, Test & Maintain the complete data management &
processing systems
Building highly scalable, robust & fault-tolerant systems
Taking care of the complete ETL(Extract, Transform & Load) process
Ensuring architecture is planned in such a way that it meets all the business requirements

11. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer Responsibilities
Discovering various opportunities for data acquisitions and exploring new ways of using
existing data
Proposing ways to improve data quality, reliability & efficiency of the whole system
Creating a complete solution by integrating a variety of programming languages & tools
together
Creating data models to reduce system complexity and hence increase efficiency &
reduce cost

12. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer Responsibilities
Discovering various opportunities for data acquisitions and exploring new ways of using
existing data
Creating a complete solution by integrating a variety of programming languages & tools
together

13. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Let’s look at the required skills to fulfil Big Data Engineer responsibilities

14. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Job Description
B i g D a t a
E n g i n e e r

15. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Job Description
B i g D a t a
E n g i n e e r

16. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Job Description
B i g D a t a
E n g i n e e r

17. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer - Required Skill Sets

18. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Engineer Skills
Operating Systems &
Programming Language
Big Data Frameworks
DBMS & SQL
Technologies NoSQL Technologies
ETL/Data Warehousing

19. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Operating Systems &
Programming Language
Big Data Frameworks
DBMS & SQL
Technologies NoSQL Technologies
ETL/Data Warehousing
< >

20. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Operating System & Programming Language
Operating Systems Programming Languages
Intimate knowledge of UNIX, Linux,
Windows and Solaris is very helpful
Knowledge of one programming
language is required. Python or R would
be a plus point.

21. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Operating Systems &
Programming Language
Big Data Frameworks
DBMS & SQL
Technologies NoSQL Technologies
ETL/Data Warehousing

22. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
DBMS & SQL Technologies
DBMS SQL
Knowledge of Database Management
System is required to define, construct &
manipulate relational databases
Knowledge of one Relational Database is
required.

23. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Operating Systems &
Programming Language
Big Data Frameworks
DBMS & SQL
Technologies NoSQL Technologies
ETL/Data Warehousing

24. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
ETL & Data Warehousing
ETL & Data Warehousing
Knowledge of UNIX, Linux, Windows and
Solaris is very helpful

25. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Operating Systems &
Programming Language
Big Data Frameworks
DBMS & SQL
Technologies NoSQL Technologies
ETL/Data Warehousing

26. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
NoSQL Databases
NoSQL Databases
Intimate knowledge of UNIX, Linux,
Windows and Solaris is very helpful

27. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Operating Systems &
Programming Language
Big Data Frameworks
DBMS & SQL
Technologies NoSQL Technologies
ETL/Data Warehousing

28. Copyright © 2017, edureka and/or its affiliates. All rights reserved.
Big Data Frameworks
Big Data Frameworks
Storage, Resource
Management &
Processing
Framework
Processing
Framework
NoSQL
Database
Other
Tools
Ingestion
Tools

29. YouTube Video Link in the Description