[EXPERIMENTAL] This repo includes deployment instructions for running HDFS/Spark inside docker containers. Also includes spark-notebook and HDFS FileBrowser.
Role in this project:
DevOps Engineer Contributions:42 commits, 10 PRs, 37 pushes in 2 years 6 months
Contributions summary:Ivan primarily contributed to the infrastructure and build process of the project. They wrote shell scripts to configure Hadoop and Spark components within Docker containers, modified build scripts, and updated image building processes. Key contributions include creating Dockerfiles, modifying entrypoint scripts, and adapting the build process to integrate Hue. They also refactored the build process to align with a new organizational structure.
docker-containerfile-browserhdfsspark
Role in this project:
DevOps Engineer Contributions:17 commits, 21 pushes, 2 branches in 9 months
Contributions summary:Ivan focused on configuring and setting up the environment for running Apache HBase in a Dockerized environment. Their contributions involve modifying the `entrypoint.sh` scripts to configure HBase properties, and writing scripts to start HBase master and regionservers. Further, the user implemented logic for preconditions in containers using `wait_for_it`. The changes indicate work towards creating a runnable local and/or distributed HBase cluster using Docker.