JCW is currently working on a search for a Risk Data Engineer with a leading consumer lending organization for their Portland, Oregon location. The qualified candidate will build and optimize foundational data marts, which will support reporting and analysis across the Risk Department, and other areas in the organization. This will include building data pipeline architecture, data flows, data transformations and clear documentation. The incumbent will be joining the Risk analytics team and partner with data owners and users to build, problem-solve and optimize key data structures. As a firm, they’re transitioning to data warehouse and analytics to Azure cloud and databricks analytics platform.

Responsibilities include:

• Create and manage large, complex data sets that meet business requirements and serve as the foundation behind analytics and management reporting, informing critical decision making across the organization.
• Create and maintain optimal data pipeline architecture, including optimal extraction, transformation and loading of data, leveraging databricks note books, Apache Spark (SQL, Python, Scala) and other Microsoft Azure or open source tools as required.

Position requirements:

• A minimum of 2 years of experience in a Data Engineer role.
• Experience with the following tools: SQL or relational databases, Python, data pipeline management such as SSIS, Azure Data Factory or Apache Spark for batch and streaming.
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
• Ideally this candidate has experience with the following tools: Apache Spark, databricks, Hadoop or comparable tool

We aim to be an equal opportunity recruiter and we are determined to ensure that no applicant receives less favourable treatment on the grounds of gender, age, disability, religion, belief, sexual orientation, marital status, or race, or is disadvantaged by conditions or requirements.