Data Engineer - Information Systems - Illinois Secretary of State

Job Title:    Data Engineer – Information Systems
Division:     Administrative
Union:         N/A
Location:    501 S Second St,Springfield, IL – Sangamon County

Salary:        Salary Commensurate with experience.
          
Overview: 

Responsible for designing, building, and maintaining the architecture that allows for the efficient collection, storage, and analysis of large volumes of data.

Duties and Responsibilities:

• Design and construct robust, scalable data pipelines (e.g., ETL, Real-Time Analytics, etc.) to collect, integrate, process, and organize large amounts of data from various sources and formats for analysis and actionable insights.
• Implement and manage databases and data storage solutions, ensuring they are optimized for performance, reliability, and scalability.
• Architect data systems and infrastructures that support data collection, storage, processing, and analysis, aligning with requirements and architecture goals.
• Develop and enforce policies and procedures for data management, quality control, and governance to ensure data accuracy, completeness, and security.
• Monitor, troubleshoot, and optimize data processing workflows and storage solutions to improve efficiency and reduce latency.
• Collaborate with data analysts, data scientists, and business teams to understand data needs and deliver solutions that support data-driven decision-making.
• Implement security measures to protect data and ensure compliance with data protection regulations and standards (e.g., NIST 800-53, State/Fed-Level privacy legislations)
• Document data systems, architectures, and processes, and share technical knowledge with team members to support collaboration and innovation.
• Performs other duties as required or assigned.

Specific Skills:

• Proficiency in languages such as Python, Java, Scala, or SQL for data manipulation and pipeline development.
• Experience with big data technologies and ecosystems such as Hadoop, Spark, Kafka, and Hive for processing large datasets.
• Knowledge of database management systems (DBMS), including traditional relational databases (MySQL, PostgreSQL) and NoSQL databases (MongoDB, Cassandra), and expertise in database design and SQL.
• Familiarity with tools like Apache Airflow, Luigi, or AWS Data Pipeline for orchestrating complex data workflows.
• Understanding of cloud services and infrastructure as offered by AWS, Google Cloud Platform, or Microsoft Azure, especially services related to data storage, processing, and analytics.
• Skills in data modeling and the design of ETL (Extract, Transform, Load) processes for efficient data extraction, transformation, and loading.
• Effective communication skills for collaborating with team members and explaining technical concepts to non-technical stakeholders.
• Ability to analyze requirements and design complex data systems and architectures.
• Certifications such as AWS Certified Data Analytics – Specialty, Google Cloud Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate, or Cloudera Certified Professional (CCP) Data Engineer.
• Continuous learning mindset to stay updated with the latest technologies and tools for data engineering and analytics, incorporating them into the data ecosystem to enhance capabilities.
• Requires willingness to travel and possession of a valid Illinois driver’s license as required by individual positions within the class.

Education and Work Experience:

Requires knowledge, skill and mental development equivalent to the completion of four years college, preferably with courses in computer science, management information systems, mathematics or statistics AND minimum three years' experience as a Data Engineer.

Application Process: 

• Please visit https://ilsos.applytojob.gov/apply to apply by completing the online application; you may also upload a resume or other attachments as needed.
• Preference will be given to Illinois residents in the hiring and selection process, in accordance with the Illinois Secretary of State Merit Employment Code.
• Questions regarding this posting or Illinois Secretary of State employment practices may be directed to Job Counselors at our Personnel offices in Chicago (312-793-5515) or Springfield (217-782-4783).  

 
Equal Employment Opportunity Employer. Applicants must be lawfully authorized to work in the United States.
Applicants are considered for all positions without regard to race, color, religion, sex, national origin, sexual orientation, age, marital or veteran status, or the presence of a non-job-related medical condition or disability.