Data engineering - MEDevel.com

10 Top Open Source Privacy-First Web Analytics

Google Analytics is a free web analytics service offered by Google that tracks and reports website traffic, allowing website owners to gain insights into the behavior of their users. It provides various tools and metrics to measure website performance, such as the number of visitors, their demographics, the pages they

Data science

10 Use Cases for Web Scrapping!

This blog post will provide an overview of web scraping and its importance in today's digital landscape.

Open-source

Build A Backend For Your Apps in Mins with The Low-code Pocketbase

Pocketbase is a free low-code open-source solution that offers developers a fast way to build backend systems for their apps. It is written in the Go programming language and works extremely fast. Also, it does not take much to setup on Windows, Linux, and macOS. Pocketbase comes in a compact

Open-source

Carbon Is an Awesome Data Reporting tool

Carbon is a free open source report generator that allows you to generate reports from many file formats as well as office suites like Microsoft Word, Google Docs, and LibreOffice. If supports many formats that include PDF, DOCS, XLSX, ODT, PPTX, ODS, XML, CSV and JSON files. Carbon can be

Database

Termdbs: Manage your Databases and CSVs from the Terminal

Termdbs is a free open-source lightweight terminal app that allows you to view and edit local database (SQLite) and large CSV files. It offers a straightforward terminal interface that you can easily use with many useful shortcuts, or by using your mouse and mouse scroll. With Termdbs, you can navigate

Self-hosted

Grist: An Open-source Spreadsheet Solution and Airtable Alternative

Grist is a free open-source web-based app that allows you to create, edit, manage and manipulate spreadsheet files with your team and group. In contrast, Grist is a relational spreadsheet that takes data management to the next level. Import your data, link records across tables, and arrange your data in

low-code

Mathesar is An Open-source Low-Code Database Interface

Airtable is a popular low-code web service that allows you to manage your data with your team. Moreover, customize your workflow, work on complex data sheets. Here, we provide you a simple open-source alternative for it, that allows you to do almost the same, with more control of your data.

search-engine

Tantivy: Open source Full-Text Search Engine

Tantivy is a full-text search engine library written in the Rust programming language. It is closer to Apache Lucene than to Elasticsearch or Apache Solr in the sense it is not an off-the-shelf search engine server, but rather a crate that can be used to build such a search engine.

Visualization

21 Open Source Free Map Design and Geo Visualization Tools

Designing maps might seem easy, but it is not, especially when many tools require certain levels of technical knowledge. A good map design can promote your presentation, website, and increase your work exposure. Data scientists, business analysts, marketeers, advertisers, and many other professions require map design in their daily work.

Social Media

EagleEye: Social Media Scrapper

Find their Instagram, FB and Twitter Profiles using Image Recognition and Reverse Image Search.

Open-source

Fityk is A Multi-platform Open-source Data-analysis Package for Scientists

Fityk [fi:tik] is an open-source program for data processing and nonlinear curve fitting, that works for Windows, Linux and macOS. Usage It is primarily used: * by scientists who analyse data from powder diffraction, chromatography, photoluminescence and photoelectron spectroscopy, infrared and Raman spectroscopy, and other experimental techniques, * to fit peaks

Python

OSMnx: Analyze and Visualize Street Networks with Python and OpenStreetMap

OSMnx: Python for street networks. Retrieve, model, analyze, and visualize street networks and other spatial data from OpenStreetMap.

Maps

Design Beautiful Maps Easily with TileMill

TileMill is a modern map design studio powered by Node.js and Mapnik.

Programming

Collabortive Database Manager and Editor for teams

What is OmniDB? OmniDB is an open source browser-based app designed to access and manage many Database Management systems, e.g. PostgreSQL, Oracle and MySQL. OmniDB can run either as an App or via Browser, combining the flexibility needed for various access paths with a design that puts security first.

Programming

16 Open-source Physics Simulation Engine

What is a physics simulation engine? A physics simulation engine is a custom software engine that grants developers add visual effetcs, simulate and tweak objects and enviroments accroding to the law of physics in 2D, 3D or both. With physics engine software, developers and artists apply real-world physical properties, such

Open-source

Xidel is an open-source data extraction tool

A platform independent command line tool to download webpages and extract data from them, using XPath 2 / XQuery expressions, CSS 3 selectors or custom pattern-matching templates. It is kind of an example for my internet tools.

Visualization

TerriaJS is an open-source web-based geospatial cataloging framework

TerriaJS is an open-source framework for web-based geospatial catalog explorers.

CMS

Magda is an open-source Big Data cataloging system

Magda is a data catalog system that will provide a single place where all of an organization's data can be cataloged, enriched, searched, tracked and prioritized - whether big or small, internally or externally sourced, available as files, databases or APIs. Magda is designed specifically around the concept of federation

Data Analysis

DuckDB is an in-process SQL OLAP database management system

What is DuckDB? DuckDB is a relational (table-oriented) DBMS that supports the Structured Query Language (SQL). DuckDB is designed to support analytical query workloads, also known as Online analytical processing (OLAP). These workloads are characterized by complex, relatively long-running queries that process significant portions of the stored dataset, for example

Open-source

Top 17 Free, open-source SQL clients for productive database management

What is an SQL client and What SQL Database client? Structured Query Language (SQL) is a domain-specific language built to aid in designing and managing data in relational databases. There are many types of SQL databases like MySQL, MariaDB, Oracle DB, PostgreSQL, and MSSQL. SQL client is a program that

Web Development

Manage your PostgreSQL Time series with TimescaleDB (open-source)

What are time series? Time series is a series of time-value pairs in a successive, timely order. As an example, a daily/or a monthly closing price over a year. It is commonly used for storing, searching, retrieving, and managing timely data. Time series has 4 components which are: 1.

Data Analysis

Makhber: An Open-source data visualization and analysis package

Visualization and Analysis of Scientific Data for Windows, Linux and macOS

Reviews

Logmore: Condition Loggers and Data Analytics for the Supply Chain

Products such as food items and pharmaceuticals often contain sensitive, perishable goods that need to be handled carefully during shipment and storage. If not handled with the proper care, these goods can go bad and have the possibility of becoming harmful for consumption. Businesses all around the world are losing

Data science

35 Data Science Python Libraries for Scientists

Python is an interpreted general-purpose programming language. It is used for web development, desktop application development, system scripting and automation. It is a high-level language created in the early 1991 by Guido van Rossum and maintained by Python Software Foundation. The language is easy to learn which makes it suitable

Data science

Run SQL queries on Data files with TrdSQL

Trdsql is a command-line python application that execute SQL queries on flat data files like CSV, TSV, LTSV, TBLN and JSON files. It also allows exporting the outputs in several formats. The application is written in Go language which known for speed and performance. The reason why did we choose