Pinned Loading

1. Realtime-ETL-DataPipeline-Using-Avro_Schema_Registry-Spark-Kafka-HDFS-Hive-Scala Realtime-ETL-DataPipeline-Using-Avro_Schema_Registry-Spark-Kafka-HDFS-Hive-Scala Public

   Bigdata processing (Realtime ETL DataPipeline) using Avro Schema Registry, Spark, Kafka, HDFS, Hive, Scala, docker, spark-streaming

   Scala 3

2. Bixi-Cloud-ETL-Data-Pipeline-using-Scala-Hive-AWS_Athena_JDBC-Driver Bixi-Cloud-ETL-Data-Pipeline-using-Scala-Hive-AWS_Athena_JDBC-Driver Public

   An Automated ETL Data pipeline which extract complex json data from web API service (GBFS-bixi Data) and convert to CSV for loading into Data-warehouse HDFS. After-that, Hive will process the furth…

   Scala 2

3. Customer-Segmentation_K-Means-Clustering-in-R Customer-Segmentation_K-Means-Clustering-in-R Public

   Which stock prices behave similarly? Organization wants to know which companies are similar to each other to help in identifying potential customers of a SAAS software solution (e.g. Salesforce CRM…

   R 1

4. PySpark-Recommender-System PySpark-Recommender-System Public

   With this activity, I warmup myself to get a practical hands-on of recommender systems in Spark. We will use the MovieLens dataset sample provided with Spark and available in directory `data`.

   Jupyter Notebook 2

5. Code-Smell-Prediction_ML Code-Smell-Prediction_ML Public

   Python: Code smell prediction using ML (10 cross-validations)

   Jupyter Notebook 1

6. Supervised-Binary-Classifier-For-IoT-Data-Stream Supervised-Binary-Classifier-For-IoT-Data-Stream Public

   Supervised Binary Classifier For IoT Data Stream

   Jupyter Notebook 3