Почетна Преглед Помоћ
Пријавите се
code
/
transport
огледало од https://github.com/lnyemba/data-transport.git
2
0
Креирај огранак 0
Датотеке Дискусије 0 Вики

Нема описа

Дрво: 1eda49b63a
Гране Ознаке
transport
ZIP TAR.GZ
Steve Nyemba 1eda49b63a documentation пре 1 година
bin e1763b1b19 bug fix: ETL, Mongodb пре 1 година
info e7838f5de1 refactoring version 2.0 пре 1 година
notebooks 1eda49b63a documentation пре 1 година
transport f6919ccd93 bug fix: set function mongodb used for updates пре 1 година
.gitignore 92bf0600c3 .. пре 1 година
README.md 1eda49b63a documentation пре 1 година
requirements.txt 8d4ecd7a9f S3 Requirments file пре 7 година
setup.py ed5acec472 bug fixes пре 1 година

README.md

Introduction

This project implements an abstraction of objects that can have access to a variety of data stores, implementing read/write with a simple and expressive interface. This abstraction works with NoSQL, SQL and Cloud data stores and leverages pandas.

Why Use Data-Transport ?

Mostly data scientists that don't really care about the underlying database and would like a simple and consistent way to read/write data and have will be well served. Additionally we implemented lightweight Extract Transform Loading API and command line (CLI) tool.

  1. Familiarity with pandas data-frames
  2. Connectivity drivers are included
  3. Mining data from various sources
  4. Useful for data migrations or ETL

Installation

Within the virtual environment perform the following :

pip install git+https://github.com/lnyemba/data-transport.git

Learn More

We have available notebooks with sample code to read/write against mongodb, couchdb, Netezza, PostgreSQL, Google Bigquery, Databricks, Microsoft SQL Server, MySQL ... Visit data-transport homepage