Data Mining - MEDevel.com: Open-source for Healthcare, and Education

Data Mining

A collection of 26 posts

Harvest News Like a Pro: Introducing News-Please, Your Open-Source Solution for News Extraction and Archiving

Harvest News Like a Pro: Introducing News-Please, Your Open-Source Solution for News Extraction and Archiving

news-please is an open-source news crawler that extracts structured information from news websites. It uses libraries like scrapy, Newspaper, and readability, and can follow internal hyperlinks and read RSS feeds to fetch both recent and archived articles. It also features a library mode for Python developers and can extract articles

25 Best Free SQL Viewers and Clients for 2024

25 Best Free SQL Viewers and Clients for 2024

An SQL Viewer is a valuable tool for various professionals and students involved in working with databases, offering a convenient and efficient way to interact with and analyze data using SQL queries.

Trowser: Free App to Browse Large Text Files with Ease

data engineering

Trowser: Free App to Browse Large Text Files with Ease

Trowser is a browser for large line-oriented text files, implemented in 3 alternate programming languages: Tcl/Tk, Python and C++/Qt. Compared to plain text viewers, trowser adds color highlighting, a persistent search history, graphical bookmarking and a separate search result window. The search window is especially designed to be

Blazegraph™ DB: An Incredibly High-Performance Graph Database with Unparalleled Scalability

Blazegraph™ DB: An Incredibly High-Performance Graph Database with Unparalleled Scalability

Blazegraph™ DB is an incredibly high-performance graph database that provides support for Blueprints and RDF/SPARQL APIs. With the ability to handle up to 50 Billion edges on a single machine, it offers unparalleled scalability. This powerful database is trusted by Fortune 500 companies such as EMC, Autodesk, and many

Understanding Big Data and How to Synthesize its Usage

Understanding Big Data and How to Synthesize its Usage

Think of the term Big Data as a way to funnel multiple data streams into one medium in order to analyze it. And by analysis, we mean fishing out trends as well as insights. This isn’t a new concept; it’s been around since the 1950s and has been

10 DataFrame Tricks with Pandas (Python Tutorial)

10 DataFrame Tricks with Pandas (Python Tutorial)

Pandas is an incredibly popular open-source data manipulation and analysis library for Python. It has gained immense popularity due to its ability to simplify complex data handling tasks. With Pandas, you can effortlessly work with various data structures and leverage a wide range of data analysis tools to manipulate and

CKAN: The Essential Open-Source Data Management Platform for Organizations and Governments

CKAN: The Essential Open-Source Data Management Platform for Organizations and Governments

CKAN is an open-source data management platform and self-hosted data portal that is widely used by various organizations and governments around the world. It plays a crucial role in facilitating the publication, management, and sharing of data. With CKAN, organizations and governments can effectively store, organize, and distribute their data,

19 Open-source Self-hosted Free Data Dashboard For Business Intelligence

19 Open-source Self-hosted Free Data Dashboard For Business Intelligence

What is a Data Dashboard A data dashboard for business intelligence is a powerful tool that enables organizations to make sense of their data and gain valuable insights. It provides a visual representation of key metrics, trends, and performance indicators, allowing users to monitor and analyze data in real-time. Benefits

14 Top Free and Open-source Log File Viewers

14 Top Free and Open-source Log File Viewers

What is a log file? A log file is a file that records events, actions, and system messages generated by various software applications, operating systems, or devices. It serves as a detailed record of activities and can be useful for troubleshooting, analysis, and auditing purposes. What is a log file

Data Visualization using Python Pandas library

Data Visualization using Python Pandas library

In this tutorial, we will explore how to use Pandas to visualize data. We will cover various techniques and code snippets to create insightful visualizations. Let's dive in! 1- Import the necessary libraries: import pandas as pd import matplotlib.pyplot as plt 2- Load the data into a

RATH is an Open-source, Self-hosted Platform for Data Exploration, Visualization, and Analysis

RATH is an Open-source, Self-hosted Platform for Data Exploration, Visualization, and Analysis

RATH is not only an open-source alternative to data analysis and visualization tools like Tableau, but it goes beyond that. It revolutionizes the exploratory data analysis workflow by leveraging its augmented analytic engine to automatically uncover patterns, insights, and causal relationships. Moreover, it takes these discoveries a step further by

Kuwala: Open-source Self-hosted No-Code Data Workspace for Business Intelligence (BI) Analysts

Kuwala: Open-source Self-hosted No-Code Data Workspace for Business Intelligence (BI) Analysts

Kuwala is a data workspace that allows BI analysts and engineers to collaborate on building analytics workflows. It brings together data engineering tools like Airbyte, dbt, and Prefect into an intuitive interface. Kuwala emphasizes extendability, reproducibility, and enablement, empowering analysts and engineers to focus on their strengths. Key features include

Chartbrew: Open-source Web App to Connect Databases and APIs

Chartbrew: Open-source Web App to Connect Databases and APIs

Open-source web platform used to create live reporting dashboards from APIs, MongoDB, Firestore, MySQL, PostgreSQL, and more 📈📊

14 Open-source Free Google Map Scrapping Tools and Scripts

14 Open-source Free Google Map Scrapping Tools and Scripts

Google Maps is a web mapping service developed by Google. It offers satellite imagery, street maps, panoramic views of streets, real-time traffic conditions, and route planning for traveling by foot, car, bicycle or public transportation. It is one of the most popular and widely used digital mapping services in the

Google Maps Scraper: Scrap Rich Data From Google Maps

Google Maps Scraper: Scrap Rich Data From Google Maps

This is a small lightweight Python + JavaScript project that enables you to scrap Google Map leads in almost no time. Features 1. Scrape up to 1200 Google Map Leads in just 25 minutes, providing you with an extensive pool of potential customers to drive sales. 2. Access 30 Data Points,

WebHarvest: Open-source Free Web Data Extraction Tool

data engineering

WebHarvest: Open-source Free Web Data Extraction Tool

Web data extraction (also known as web data mining or web scraping) is an incredibly useful tool for extracting valuable information from arbitrary web pages. It employs well-proven technologies such as XML and text processing to make the extraction process easy and efficient. With the help of web data extraction

Open Metadata: Discover, Manage and Collaborate on your Data

data engineering

Open Metadata: Discover, Manage and Collaborate on your Data

OpenMetaData is a comprehensive platform that offers a range of functionalities, including data discovery, data lineage, data quality, observability, governance, and team collaboration. It is an open-source project that has gained immense popularity among companies across various industry verticals, thanks to its vibrant community and adoption. OpenMetaData is built on

Swiple: Open-source Automated Data Monitoring

Swiple: Open-source Automated Data Monitoring

The data quality automation plugin for data teams. Experience data quality observability in your ELT/ETL pipeline that would usually take a year to build, in just a few hours.

DQO: Open-source Data Quality Operations Center

DQO is a powerful DataOps friendly data quality monitoring tool that is designed to help you monitor and maintain the quality of your data. With DQO, you get access to a wide range of customizable data quality checks and data quality dashboards that make it easy to keep an eye

22 Open-source Business Intelligence (BI) Dashboards

22 Open-source Business Intelligence (BI) Dashboards

Business Intelligence, commonly known as BI, is the process of collecting, analyzing, and presenting data to make informed business decisions. BI helps organizations to transform their raw data into meaningful insights that can drive their business strategies. BI provides a range of advantages to organizations, including improved decision-making, increased efficiency,

Urungi: Open-source Business Intelligence and Reporting tool for SQL Database Engines

Urungi: Open-source Business Intelligence and Reporting tool for SQL Database Engines

Urungi is a powerful tool that is designed to help you easily create and manage statistics and dashboards, no matter where your data comes from. With Urungi, you can take advantage of a range of features that will help you get the most out of your data. To begin with,

Top Programming Languages for Data Science

Top Programming Languages for Data Science

Data science is an important instrument in the modern world. A lot of computers gather a lot of bytes of information about users behavior, weather, results of sports games and all other kinds of content that appears every second. However, there are a lot of questions about the quality of