Tag: corporate

Full-stack data processing system, from intake forms, to data-cleaning, to reporting and dashboards.

I was tasked with designing and implemented a full-scope data system for an inspection program with multiple different constituencies.

The solution had many constraints, including the requirement to work seamlessly with a loosely affiliated network of consultants and members.

The data-intake form was built on top of Excel, as it was a tool that everyone was familiar with. Extensive controls and guidelines were built into the Excel form. Then a data-ingestion pipeline was built in python to clean and review data the data and put it into an SQL database.

From there, numerous python scripts were developed to manage the intake forms, report on the data, and manage the program.

In parallel, another SQL database was developed to host an inspection management and scheduling platform, from which a front-end database portal app was built using the app-builder DronaHQ.

Requirements:

• data intake
• data quality assurance
• data warehousing
• reporting
• live data dashboards

Tools:

• Python (pandas, openpyxl, sqlalchemy)
• MySQL
• BOX.com
• Excel
• DronaHQ

A regional company involved in inspections and contracting was buckling under the pressure of a 100% increase in project volume within 12 months.

To that date, the existing tried-and-true program management methods of legal pads, filing cabinets, and paper charts had been working just fine. But with the increased volume, the pressure and anxiety had jumped up.

Working with the whole team, I led the development of a project management system based on Salesforce. In discovery/design, we investigated custom programmed solutions, and an app built on Salesforce was projected to be less expensive to build and quicker to iterate.

I knew that the new system would be a dramatic process change, so the project involved an extensive training and onboarding phase to bring all team members into the new system, and successfully train them on the new methods.