0
I Use This!
Activity Not Available

Commits : Listings

Analyzed 12 months ago. based on code collected 12 months ago.
Jan 18, 2023 — Jan 18, 2024
Commit Message Contributor Files Modified Lines Added Lines Removed Code Location Date
updated default EMR AMI to 6.0.0 More... over 4 years ago
added docker opts to docs More... over 4 years ago
tested docker_image and pooling More... over 4 years ago
tested docker_client_config option More... over 4 years ago
tested docker_mounts option More... over 4 years ago
Correct the link to the configuration documentaion. More... over 4 years ago
fully tested docker_image, fixed --no-docker switch More... over 4 years ago
remove default for docker_registry More... over 4 years ago
refactored docker_image test somewhat More... over 4 years ago
some tests for docker_image option More... over 4 years ago
don't need -v for run_and_get_cluster() More... over 4 years ago
entirely remove docker_registry option from EMR runner More... over 4 years ago
fixed emr pooling tests More... over 4 years ago
updated Dataproc tests now that bootstrapping doesn't include mrjob.zip More... over 4 years ago
make pooling debug message a bit more transparent More... over 4 years ago
turns out we don't need to trust the centos registry More... over 4 years ago
docker registry is part of emr_configurations More... over 4 years ago
updated EMR unit tests to no longer assume mrjob.zip is part of bootstrapping More... over 4 years ago
fix --docker-mounts option (should combine lists) More... over 4 years ago
infer docker registry from image, prepend library/ to image More... over 4 years ago
remove default for docker mounts More... over 4 years ago
add tmp dir to .gitignore More... over 4 years ago
dataproc runner doesn't need to add mrjob zip to bootstrap either More... over 4 years ago
removed bootstrap_mrjob from list of things for pooling to match More... over 4 years ago
don't need this either (bootstrap_mrjob) More... over 4 years ago
don't sudo install mrjob on the master node, since it's in py_files More... over 4 years ago
mrjob is now always bootstrapped in py_files, as this is the only way to get it into Spark/Docker images More... over 4 years ago
always include "centos" in list of registries More... over 4 years ago
add docker_mounts to environment variables More... over 4 years ago
oops, this has to be through cmdenv, not jobconf More... over 4 years ago