Senior Data Engineer at ACE American Insurance Company (Chubb)

Senior Data Engineer (ACE American Insurance Company (Chubb)) (Philadelphia, PA): Developing and delivering advanced analytics software applications for use within Chubb’s broader operations; Working with Kafka and spark streaming to support streaming ingestion pipelines; Creating/modifying deployment templates to deploy services/pipelines to company infrastructure in the cloud; Working with NoSQL databases to ingest data from different source systems; Working with Databricks medallion architecture; Collaborating with stakeholders to identify requirements for complex business problems and understand expected business outcomes; Designing, developing and implementing data pipelines and related software using distributed cloud-based technologies supporting data processing initiatives across batch and streaming datasets; Exploring new ways of producing, processing, and analyzing data at scale, as well as prototyping and testing software that supports these methodologies; Working within a multi-functional agile software team with end-to end responsibility for product development and delivery; Identifying, evaluating, and implementing leading edge data management frameworks required to address complex large-scale data challenges; Collecting and analyzing data from diverse internal and external sources and assessing the effectiveness, accuracy of the data and data gathering techniques to inform future operations; Providing architectural support by building proof of concepts & prototypes; Regularly reviewing and evaluating emerging technologies and industry trends, as well as reviewing ways in which these technologies can support future Chubb development operations; Maintaining a high level of understanding of technology including Kubernetes, Azure, Databricks and more, as well as applying that knowledge to projects; Coordinating and leading global implementation projects, taking responsibility for scope, definition, project planning, development efforts, testing, and deployment, as well as evaluating any issues and overseeing efforts to remedy same; and Play the lead role in implementation, testing, monitoring and continuous maturity of Chubb’s Data Engineering Streaming Framework. Must have experience with the following in order to complete the above-mentioned tasks: Knowledge of data analytics and the related underlying computing infrastructure; Experience with containerization of APIs and deployment on Cloud platforms; Experience with integration patterns with front-end systems using open-source technologies such as: KAFKA, Python and Kubernetes; Experience programming in python or C#.net; Experience designing and developing REST APIs using microservices architecture; Experience with Microsoft Azure and experience writing database queries, creating database components using SQL; Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations; Understanding of Azure Data Lake Technologies like CosmosDB, Azure Data Factory and Databricks; and Understanding of Data Engineering and Data Science Reference Architecture. Requires a Bachelor’s degree or foreign equivalent in Computer Science, Software Engineering, Information Systems or a closely-related field, and at least five (5) years of experience as a Data Engineer, Data Scientist or related occupation in a corporate IT environment. In the alternative, a Master’s degree and two (2) years of experience in the above-mentioned field and occupation is required. Option to work from home partially is available. Itinerant Employment - Employee may be required to work at various unanticipated locations throughout the U.S. Incidental travel may be required to client's offices located throughout the U.S. Current worksite: 10 Exchange Place, Jersey City, NJ 07302. Salary: $169,229.00 - $175,000.00/year. Please send C.V. to matthew.palmer@chubb.com




#LI-DNI