The following functions are the responsibility of the Big Data and Analytics Administrator within Data Team
Administration knowledge and experience in various data and analytics software from SAP, IBM, Informatica, Cloudera, Hortonworks
Design and deploy a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running hadoop jobs
Implementing, managing and administering the overall hadoop infrastructure.
Takes care of the day-to-day running of Hadoop clusters
A hadoop administrator will have to work closely with the database team, network team, BI team and application teams to make sure that all the big data applications are highly available and performing as expected
Hadoop admin is responsible for capacity planning and estimating the requirements for lowering or increasing the capacity of the hadoop cluster
Manage and review Hadoop log files.
Backup and recovery tasks
Resource and security management
Troubleshooting application errors and ensuring that they do not occur again
Experience in data operations and production support processes
Work as an integrated member of the big data technology team and drive cross functional international Big Data initiatives from beginning to end with various business units
Admin responsibility for Data Lake, Master Data Management, Data Warehouse, and Distributed Master Data
Work with department and team leads to expand current architecture’s scalability
Help design, instantiate, and maintain data storage setups for analytics and data science
Troubleshoot all parts of the data pipelines as necessary
Required – 5+ years’ administration experience in various big data integration technologies focusing on Cloudera, Hortonworks, Informatica Big Data Management, PowerCenter, and Data Quality
Preferred – 2+ years’ administration or development experience in reporting and analytics i.e. SAP BW, SAP Hana and SAP BI
Bachelors Degree in Computer Science, Information Systems, or equivalent
PMC is a leading provider of quality, engineering, manufacturing, supply chain, operations productivity, and IT Staffing solutions. Our solutions help customers shorten product life cycles, increase quality and throughput, reduce lead time, and improve their return on capacity and technology investments (ROI). Please visit www.PMCorp.com to learn more.