Data Engineer & Architect

Ianverse

ianverse.com

Building data systems at the scale of universes — pipelines, platforms, and analytics that turn raw signals into constellations of meaning.

Explore Work Get in Touch

About the Universe

Crafting order
from cosmic chaos

I'm Ian — a Data Engineer who sees every dataset as a galaxy waiting to be mapped. My craft is building the infrastructure that makes data explorable, reliable, and fast.

From ingestion to transformation to serving, I design end-to-end pipelines that scale without breaking a sweat — because in the ianverse, every byte has a purpose.

Years Engineering

40+

Pipelines Built

5TB+

Data Processed Daily

99.9%

Pipeline Uptime

ian_profile.json

{
  "name": "Ian",
  "domain": "ianverse.com",
  "role": "Senior Data Engineer",
  "location": "Earth, Milky Way",
  "specialties": [
    "Data Pipelines",
    "Cloud Architecture",
    "Stream Processing",
    "Data Modeling"
  ],
  "coffee_per_day": 3,
  "open_to_work": true
}

The Tech Constellation

My tools of the universe

⚡

Apache Spark

Distributed processing at galactic scale. Batch and streaming unified.

🌊

Apache Kafka

Real-time event streaming. The heartbeat of the data universe.

🐍

Python

Orchestration, transforms, and everything in between.

☁️

AWS / GCP

Cloud-native architectures. S3, Glue, BigQuery, Dataflow.

🔷

dbt

Transformation layer. Models, tests, docs — the data warehouse tamed.

🎯

Airflow

Orchestration of complex DAGs spanning the entire data cosmos.

❄️

Snowflake

Cloud DWH at scale. Warehousing without limits.

📦

Terraform

Infrastructure as code. Every resource, version-controlled.

Missions Launched

Projects from the ianverse

Data Platform

Nebula Data Lake

A petabyte-scale data lake built on AWS with automated schema discovery, data cataloging, and self-service access for 200+ analysts. Reduced query time by 70%.

AWS S3 Glue Spark Terraform

Real-time Pipeline

Pulsar Event Stream

High-throughput Kafka streaming pipeline processing 2M events/sec. Powers real-time dashboards, fraud detection, and customer personalization engines.

Kafka Flink Python Redis

Warehouse & Analytics

Orion Analytics Hub

End-to-end Snowflake DWH migration from legacy SQL Server. 400+ dbt models, automated testing, and Looker integration serving executive dashboards.

Snowflake dbt Airflow Looker

Orbital History

Where I've orbited

2022 — Present

Senior Data Engineer

◈ Stellar Technologies

Leading the design and implementation of a cloud-native data platform processing 5TB daily. Architecting real-time streaming solutions and mentoring a team of 5 engineers.

2020 — 2022

Data Engineer

◈ NovaSystems

Built and maintained ETL pipelines for e-commerce analytics. Migrated legacy data warehouse to Snowflake, cutting infrastructure cost by 40%.

2018 — 2020

Junior Data Engineer

◈ DataCosmos Inc.

Developed Python-based ingestion pipelines for financial data. Introduced automated data quality checks that reduced reporting errors by 80%.

◈ Transmission Ready

Let's build your
universe

Have a data challenge that needs solving at scale? I'm open to new missions, collaborations, and conversations.

ian@ianverse.com

LinkedIn GitHub Twitter / X Resume