User:Elukey/Misc/Bigtop

The printable version is no longer supported and may have rendering errors. Please update your browser bookmarks and please use the default browser print function instead.

How to build packages for Bigtop 1.5

Clone the repository https://github.com/apache/bigtop/
Checkout branch-1.5 for Bigtop 1.5
Apply patches/changes if needed.
Bump bigtop.bom's version (if needed, see below).
Use docker to build a package. For example, if we want to rebuild hive: docker run --rm -v `pwd`:/ws --workdir /ws bigtop/slaves:1.5.0-debian-10 bash -c '. /etc/profile.d/bigtop.sh; ./gradlew hive-clean hive-pkg'

Limitations

The bigtop.bom file contains the version of the package that will be built, for example the following diff is enough to build hive_2.3.6-3_all.deb:

diff --git a/bigtop.bom b/bigtop.bom
index a01d7152..57f920be 100644
--- a/bigtop.bom
+++ b/bigtop.bom
@@ -180,7 +180,7 @@ bigtop {
     'hive' {
       name    = 'hive'
       relNotes = 'Apache Hive'
-      version { base = '2.3.6'; pkg = base; release = 2 }
+      version { base = '2.3.6'; pkg = base; release = 3 }
       tarball { destination = "apache-${name}-${version.base}-src.tar.gz"
                 source      = destination }
       url     { download_path = "/$name/$name-${version.base}/"

The Debian changelog can't be modified afaik, it is a limitation, but it shouldn't be a big problem.

Bigtop also uses images from Dockerhub, and we don't have them on deneb for the moment. So the current workflow is to build locally and scp to apt1001.