Now v0.2 available

Databases Analytics Tools

From Code to Pipeline.

A micro Python framework to simplify analytics tasks. Open-source, modular and fast.

Get Started
$ pip install db-analytics-tools
db_tools start --config config.json --address 127.0.0.1 --port 8050
UI Screenshot

About the Project

The Story Behind the Tools

DB Analytics Tools is designed and maintained by Joseph Konka, a Data Science professional with a strong passion for the Python ecosystem.

The project's journey began in 2022 at Togocom. Faced with the need to automate SQL functions execution, Joseph built a set of core foundational scripts to drastically boost workflow efficiency.

This codebase was initially packaged as SQL ETL Runner to standardize agile data pipelines. Over time, it continued to evolve modularly, transforming into the comprehensive open-source framework it is today: Databases Analytics Tools.

The Spark at Togocom

Writing the first custom Python scripts to automate workflows and eliminate time-consuming manual interventions.

SQL ETL Runner

Standardizing the internal automation codebase into a modular Python package dedicated to lightweight and agile ETL processes.

Databases Analytics Tools

A complete upgrade into a universal, open-source, and modular framework, now featuring a dedicated user interface via Docker.

Instant Connectivity

Stop wasting time with complex boilerplate. Connect and query in seconds.

Connect with two instructions:
Python
import db_analytics_tools as db

client = db.Client(
    host=HOST,
    port=PORT,
    database=DATABASE,
    username=USER,
    password=PASSWORD,
    engine=ENGINE
)
Run the UI using Docker:
Docker
docker run -p 8050:8050 \
    --restart=always \
    --mount type=bind,source=./config.json,target=/app/config.json \
    --mount type=volume,source=db_cron_data,target=/var/spool/cron/crontabs \
    --name db-analytics-tools-ui-1 \
    -d joekakone/db-analytics-tools-ui:latest

# Use Docker Compose - Download the docker-compose.yml file
# https://github.com/joekakone/db-analytics-tools/blob/master/docker-compose.yml
docker compose up -d

Supports PostgreSQL, Greenplum and SQL Server.

Core Components

Modular architecture designed to handle every step of your data pipeline.

DB Client

A high-level wrapper around SQL engines. Execute queries, manage sessions, and retrieve DataFrames with a single method call.

ETL Engine

Automate the flow of data. Built-in functions for incremental loads, streaming extraction, and schema management.

DataViz

Turn raw data into insights. Integration with top charting libraries to generate professional reports directly from your datasets.

ML

Standardized machine learning workflows. Simplified training, evaluation, and deployment of models within your data ecosystem.

Airflow

Native Airflow integration. Orchestrate your tasks with ease using our custom operators and REST API wrappers.

UI

A ready-to-use administration console built with Streamlit to monitor your pipelines and visualize your database health.

Plans & Professional Services

Deploy the free open-source framework or leverage expert data services for your business.

Open Source Core

$0 / forever

Perfect for data engineers, developers, and teams looking to automate pipelines without boilerplate overhead.

  • Full framework access & Core UI
  • 100% MIT Licensed
  • Postgre, Greenplum & SQL Server
  • Community-driven updates
Production
Dedicated Support

Custom / retainer

Peace of mind for businesses running DB Analytics Tools in critical production environments.

  • Priority bug fixes & security patches
  • Custom connector development
  • Dedicated SLA response times
  • Architecture & deployment review
Tailored Solutions

Data Services

End-to-end data engineering expertise to build, optimize, and scale your modern data stack.

  • Data Audit & Strategy
  • Data Warehousing
  • Orchestration with Apache Airflow
  • Power BI Dashboards & Reports