AVP, Global Data Ingestion - SSP
Jersey CIty, NJ
About the Job
AVP, Global Data Ingestion Product Owner
This is a rare opportunity to apply your leadership and engineering expertise to a subject you love: Data! We are looking for someone to lead and grow a talented team of data engineering professionals. This candidate will develop people, form strong working partnerships with business and technology leaders, plan and execute data ingestion programs and formulate cloud data ingestion strategies for solving business problems.
Ideal candidate will be a senior software engineer with a strong hands-on experience of building large-scale cloud based distributed data systems. The Data Ingestion Product Owner will work with the business in understanding data requirements and will serve as a technology & platform expert in designing and building technical solutions focused on Cloud-based Big Data ecosystems such as Azure Data Factory, Kafka, Informatica ICS, Databricks Spark, SQL Data Warehouse, Cosmos DB, .etc. with a focus on understanding data need for data initiatives in building scalable, distributed, and high performance computing cloud based platforms. You are a self-starter who will lead a team and take ownership of your products, projects and deliver high-quality data-driven applications. You are adept at solving diverse business problems by utilizing a variety of different tools, strategies, platforms and programming languages.
Responsibilities
The Company is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law. To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.
This is a rare opportunity to apply your leadership and engineering expertise to a subject you love: Data! We are looking for someone to lead and grow a talented team of data engineering professionals. This candidate will develop people, form strong working partnerships with business and technology leaders, plan and execute data ingestion programs and formulate cloud data ingestion strategies for solving business problems.
Ideal candidate will be a senior software engineer with a strong hands-on experience of building large-scale cloud based distributed data systems. The Data Ingestion Product Owner will work with the business in understanding data requirements and will serve as a technology & platform expert in designing and building technical solutions focused on Cloud-based Big Data ecosystems such as Azure Data Factory, Kafka, Informatica ICS, Databricks Spark, SQL Data Warehouse, Cosmos DB, .etc. with a focus on understanding data need for data initiatives in building scalable, distributed, and high performance computing cloud based platforms. You are a self-starter who will lead a team and take ownership of your products, projects and deliver high-quality data-driven applications. You are adept at solving diverse business problems by utilizing a variety of different tools, strategies, platforms and programming languages.
Responsibilities
- Develop the vision of global data ingestion into the cloud data lake by defining measurable and actionable objectives for the data ingestion team
- Reimagine batch, micro batch and real time data automation, continues integration and deployment in the regulated environment by embedding right control points in our key agile processes to achieve strong compliance and sustainable velocity; while reducing friction between data governance, data program teams.
- Derive innovation towards building highly scalable real time data ingestion and streaming pipelines capability to support global needs
- Build a global data ingestion organization that is proactive, multi-cloud oriented, business focused and pulls (as opposed to have pushed) issues into the group for rapid resolution and compliance against our standards
- Design and implement strategies to monitor the effectiveness of data management and governance programs and identify, manage and mitigate current and emerging risks
- Hire, attract and retain top talent, creating a cohesive culture that fosters innovation, transparency and collaboration
- Be an inspiring leader, mentor and coach data engineers, modelers and software engineers and be an active member of the data leadership team
- Evaluate emerging trends such as big data, open data and linked data, and determine the impacts on the future-state enterprise data architecture
- Collaborate and work with global data management stakeholders to identify requirements for complex business problems that may be loosely defined.
- Identify, evaluate and implement leading edge data management frameworks required to address complex large-scale data challenges.
- Work within multi-functional agile teams with end-to-end responsibility for product development and delivery
- Provide architectural support by building proof of concepts & prototypes.
- Stay current with emerging technologies and industry trends.
- Build, lead and inspire a team of data engineers to create and develop a world class cloud data ingestion capability to meet the changing requirements across the business
- Set the cultural tone for the cloud data lake and ingestion capability in business area and review new technologies and enhancements to data delivery and analytics tools
- Identify and take opportunities to business area to improve data, leveraging the data systems and insights centers of excellence
- Lead relationships with key internal and external stakeholders which optimize delivery of value for business area
- Provide mentoring and direction to direct reports and team members
- Agree challenging performance and development objectives for all direct reports and provide regular feedback and coaching to maximize potential, communicating team successes and challenges
- This role requires a bachelor's degree level educated and program management experience
- Candidate should have a minimum of ten years of experience in large multinational financial services industry
- Have previously held minimum of three years enterprise data engineering leadership role
- Have hands-on architecture and delivery experience in large scale, cross functional data management solutions
- Data technology literate with a detailed understanding of the modern cloud data architectures
- Must have Azure Cloud experience in the data platforms, preferably Azure certified as a cloud solution engineer
- Hands-on expertise in Azure big data ecosystems Databricks, Azure Data Lake Store, Azure Data Factory, SQL Data Warehouse, Kafka, etc.
- Must have deep experience in C#/.Net or Java programing language having implemented large scale cloud data ingestion systems
- Experience in designing and leading the conceptual, logical and physical design for distributed databases
- Experience in driving meta data architecture and Master Data Management solutions.
- Experience in performing analysis and design for data management and data driven projects.
- Excellent data analysis skills using T-SQL on Spark SQL, ANSI SQL etc.
- Good understanding of R, Python, Jupyter Notebook, RStudio, R Shiny, etc.
- End-to-end design and build process of Near-Real Time and Batch Data Pipelines
- Experienced in one or more programming languages such as C#, .net, python, scala, java, clojure or groovy
- Experienced in operating system command languages such as bash or ksh
- Experienced in development tools such as git and integrated development environments
- Familiarity with data science and analytic tool sets such as jupyter hub
- Understanding of common data frameworks and data models to apply data lake designs
- Understanding of the relational, object, document, key value, knowledge/graph modelling techniques
- Has demonstrated the ability to work well with others and be respected as a leader
- Has a track record of remaining unbiased toward specific technologies or vendors
- An excellent communicator and collaborator across multiple technical and business stakeholders and leaders
- Must be able to translate the enterprise data architecture contribution to business outcomes into simple briefings
- Very good stakeholder management skills
- Must be a self-starter, work without supervision
- Has demonstrated the ability to work across cultural and language barriers
The Company is an equal opportunity employer and makes employment decisions on the basis of merit and business needs. The Company will consider all qualified applicants for employment without regard to race, color, religious creed, citizenship, national origin, ancestry, age, sex, sexual orientation, genetic information, physical or mental disability, veteran or marital status, or any other class protected by law. To comply with applicable laws ensuring equal employment opportunities to qualified individuals with a disability, the Company will make reasonable accommodations for the known physical or mental limitations of an otherwise qualified individual with a disability who is an applicant or an employee unless undue hardship to the Company would result.
Source : SSP