datastage developer

Functional Title: Data Quality Developer (IBM QualityStage)

Target Start Date:  2/18/2020
Expected Assignment Duration: Long term

Position Description:

Participate in the discovery and analysis phase.

During the discovery phase carry out data analysis and create detail inventory the sources systems, underlying data elements, analyze and list out he known DQ Issues – both already resolved and yet to be resolved,

Complete analysis, documentation, data pipelining, staging, remediation, cleansing, quality assurance, and publication of all in scope data

Collaborate with the Data Migration team for actual data migration, data validation and system acceptance. Provide consulting support for data extract, stage, transform, and integrate the core data that is in- scope for delivery and access with the new solution.
 

Mandatory Qualifications: 

The Data Quality Developer should have 84 or more months of experience, in this role, with a combination of the experience described in the job function/description below.

• Hands on experience in delivering Data Quality projects of similar scale.  At least 2 projects. (in DMV DQ&SI There are 130 data stores involving over 200M master records, 2 Billion overall records that will need to be analyzed, prepared, and migrated).

• Extensive experience in detail data analysis, data profiling, Data Quality assessment, DQ Remediation.

• Hands on experience in IBM InfoSphere® QualityStage® , 2 years or more and IBM InfoSphere® DataStage® at least 2 years

• Knowledge of whole IBM Information Server suite (Information Analyzer, Governance Catalog, DataStage, QualityStage etc.)
• Ability to guide and advise clients in Data Management and Governance approaches, strategies, and best practices
• The qualified candidate will be required to partner with key stakeholders to provide Data Quality assessment services.
• Able to provide solutions for implementing and using the Information Server suite to attain customers data governance goals.
• Experience with data quality considerations, lineage etc.
• Experience in customizing the templates for effective inventory management of DQ issues, related remediation, communication and acceptance.
• At least 2 years of experience delivering Data Quality projects within an Enterprise organization
• At least 2 years of experience with IBM Information Governance Catalog
• At least 3-5 years of experience with IBM Information Analyzer in writing rules, configuration and profiling data
o Experience analyzing data sets or data results (e.g. profiling results, results reporting) to draw inferences and identify adherence, or lack thereof, to business requirements
o Create projects, add data sources, write, configure and execute rules/rule sets within Information Analyzer
o Develop data profiling solutions, run analysis jobs and view results, and create and manage data quality controls using Information Analyzer
o Demonstrate knowledge of Information Analyzer administrative tasks such as managing logs, schedules, active sessions and security roles etc.
o Perform column analysis, rule analysis, primary key analysis, natural key analysis, foreign-key analysis, and cross-domain analysis
o Articulate data findings in a manner that is understandable to a business team. Also, they will need to work with the business team to confirm or modify requirements and rules based on the findings
o Identify opportunities in processes, system capabilities and delivery methodologies for continuous improvement as applicable
• At least 2 years of experience with IBM InfoSphere QualityStage
o Experience in developing Parallel jobs using various stages like Join, Merge, Lookup, Surrogate key, Funnel, Sort, Transformer, Copy, Remove Duplicate, Filter, Pivot and Aggregator stages for grouping and summarizing on key performance indicators
• At least 5 years of experience with IBM InfoSphere DataStage
o Experience in handling pipeline and partition parallelism for improving performance
o Production problem solving experience using Peek, Row Generator and Column Generator Stages
o Experience in handling job sequences and job schedules to automate the ETL processes.
o Experience in handling feeds using multiple data sources such as z/OS DB2, MS SQL Server, Complex Flat Files, Delimited Files and XML files
o Experience in performance tuning and methodologies in DataStage

Basic Skills Required
• Experience with MS Office products (MS Office,
• Visio and Project experience
• Scripting - DOS/PowerShell/Unix Shell Scripting
• Experience with data quality tools
• Ability to write data rules using pseudo code

Desired Qualifications: 

Qualifications
• Expert level experience in Data Quality Design and Development, best practices and processes
• Experience with Other ETL/ELT technologies (Informatica, Pentaho, SSIS, Etc.)
• Experience in Data integration, data architecture and, project life cycle Phases, best practices and processes
• Strong data modeling (Relational Databases & Data Warehouse) and related technology skills (SQL etc.)
• Experience working with other DQ tools.
• Good understanding of Data Governance, MDM.
• Exposure to the latest technologies and frameworks in DQ.
• Experience with data lakes
• Strong written and verbal communication skills
• Experienced presenter
• Agile project management experience required
• Successful applicants will have strong interpersonal skills

Preferred Skills and Education
• IBM z/OS MVS COBOL, JCL, ISPF
• Ability to conduct analysis on the data using database querying, excel, and other methods
• Windows Server 2016
• ETL experience using SQL Server 2008, 2012, 2014, & 2016 as source or destination
• InfoSphere Information Server 11.7.1 or newer
• InfoSphere Information Server Microservices Architecture
• Master’s degree in Computer Science or related field.
• Background in data analytics
• Certifications in Data Modeling

BestAnalytics provides you the best software development services in USA and throughout the world. We offer various business software solutions whether it is customized or modify an existing Software application development (Software-development service), or to build a new application for your company. With our innovative ways we simplify how things work in their organizations by implementing adequate software or applications.