starting build "0bf75426-6e63-48ba-bd59-6306458e9170" FETCHSOURCE hint: Using 'master' as the name for the initial branch. This default branch name hint: is subject to change. To configure the initial branch name to use in all hint: of your new repositories, which will suppress this warning, call: hint: hint: git config --global init.defaultBranch hint: hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and hint: 'development'. The just-created branch can be renamed via this command: hint: hint: git branch -m Initialized empty Git repository in /workspace/.git/ From https://github.com/GoogleCloudDataproc/initialization-actions * branch cff4bac96514e99f38ae1ae05d514fe85f3277b4 -> FETCH_HEAD HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver BUILD Starting Step #0 - "docker-build" Step #0 - "docker-build": Already have image (with digest): gcr.io/cloud-builders/docker Step #0 - "docker-build": Sending build context to Docker daemon 71.32MB Step #0 - "docker-build": Step 1/7 : FROM gcr.io/cloud-builders/gcloud Step #0 - "docker-build": ---> da99d92d2163 Step #0 - "docker-build": Step 2/7 : RUN useradd -m -d /home/ia-tests -s /bin/bash ia-tests Step #0 - "docker-build": ---> Running in f44aa376ea88 Step #0 - "docker-build": Removing intermediate container f44aa376ea88 Step #0 - "docker-build": ---> a4d820c82a82 Step #0 - "docker-build": Step 3/7 : COPY --chown=ia-tests:ia-tests . /init-actions Step #0 - "docker-build": ---> edd8e795207f Step #0 - "docker-build": Step 4/7 : RUN echo "deb [arch=amd64] http://storage.googleapis.com/bazel-apt stable jdk1.8" | tee /etc/apt/sources.list.d/bazel.list Step #0 - "docker-build": ---> Running in eb7f2249bb21 Step #0 - "docker-build": deb [arch=amd64] http://storage.googleapis.com/bazel-apt stable jdk1.8 Step #0 - "docker-build": Removing intermediate container eb7f2249bb21 Step #0 - "docker-build": ---> cd6cc2072a1b Step #0 - "docker-build": Step 5/7 : RUN curl https://bazel.build/bazel-release.pub.gpg | apt-key add - Step #0 - "docker-build": ---> Running in 34286708d368 Step #0 - "docker-build":  % Total % Received % Xferd Average Speed  Time   Time Time Current Step #0 - "docker-build": Dload Upload Total Spent Left Speed Step #0 - "docker-build": 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100  4714  100  4714 0 0 50688 0 --:--:-- --:--:-- --:--:-- 50688 Step #0 - "docker-build": Warning: apt-key output should not be parsed (stdout is not a terminal) Step #0 - "docker-build": OK Step #0 - "docker-build": Removing intermediate container 34286708d368 Step #0 - "docker-build": ---> 48119c370710 Step #0 - "docker-build": Step 6/7 : RUN apt-get update && apt-get install -y openjdk-8-jdk python3-setuptools bazel Step #0 - "docker-build": ---> Running in 3c26291d20fb Step #0 - "docker-build": Get:1 http://storage.googleapis.com/bazel-apt stable InRelease [2256 B] Step #0 - "docker-build": Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] Step #0 - "docker-build": Get:3 http://storage.googleapis.com/bazel-apt stable/jdk1.8 amd64 Packages [8455 B] Step #0 - "docker-build": Get:4 http://archive.ubuntu.com/ubuntu focal InRelease [265 kB] Step #0 - "docker-build": Get:5 http://ppa.launchpad.net/git-core/ppa/ubuntu focal InRelease [23.8 kB] Step #0 - "docker-build": Get:6 http://ppa.launchpad.net/git-core/ppa/ubuntu focal/main amd64 Packages [4571 B] Step #0 - "docker-build": Get:7 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [27.7 kB] Step #0 - "docker-build": Get:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] Step #0 - "docker-build": Get:9 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [972 kB] Step #0 - "docker-build": Get:10 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] Step #0 - "docker-build": Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 Packages [1275 kB] Step #0 - "docker-build": Get:12 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2350 kB] Step #0 - "docker-build": Get:13 http://archive.ubuntu.com/ubuntu focal/multiverse amd64 Packages [177 kB] Step #0 - "docker-build": Get:14 http://archive.ubuntu.com/ubuntu focal/restricted amd64 Packages [33.4 kB] Step #0 - "docker-build": Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 Packages [11.3 MB] Step #0 - "docker-build": Get:16 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1772 kB] Step #0 - "docker-build": Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [30.4 kB] Step #0 - "docker-build": Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1273 kB] Step #0 - "docker-build": Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2820 kB] Step #0 - "docker-build": Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1887 kB] Step #0 - "docker-build": Get:21 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [28.6 kB] Step #0 - "docker-build": Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [55.2 kB] Step #0 - "docker-build": Fetched 24.7 MB in 3s (7969 kB/s) Step #0 - "docker-build": Reading package lists... Step #0 - "docker-build": Reading package lists... Step #0 - "docker-build": Building dependency tree... Step #0 - "docker-build": Reading state information... Step #0 - "docker-build": python3-setuptools is already the newest version (45.2.0-1). Step #0 - "docker-build": python3-setuptools set to manually installed. Step #0 - "docker-build": The following packages were automatically installed and are no longer required: Step #0 - "docker-build": dpkg-dev fakeroot libalgorithm-diff-perl libalgorithm-diff-xs-perl Step #0 - "docker-build": libalgorithm-merge-perl libdpkg-perl libfakeroot libfile-fcntllock-perl Step #0 - "docker-build": liblocale-gettext-perl libpython3-dev libpython3.8 libpython3.8-dev make Step #0 - "docker-build": python-pip-whl python3-dev python3-wheel python3.8-dev Step #0 - "docker-build": Use 'apt autoremove' to remove them. Step #0 - "docker-build": The following additional packages will be installed: Step #0 - "docker-build": adwaita-icon-theme fontconfig g++ gcc gtk-update-icon-cache Step #0 - "docker-build": hicolor-icon-theme humanity-icon-theme libasyncns0 libcairo-gobject2 Step #0 - "docker-build": libcairo2 libdatrie1 libflac8 libfribidi0 libgail-common libgail18 Step #0 - "docker-build": libgdk-pixbuf2.0-0 libgdk-pixbuf2.0-bin libgdk-pixbuf2.0-common libgtk2.0-0 Step #0 - "docker-build": libgtk2.0-bin libgtk2.0-common libice-dev libjbig0 libogg0 libpango-1.0-0 Step #0 - "docker-build": libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libpthread-stubs0-dev Step #0 - "docker-build": libpulse0 librsvg2-2 librsvg2-common libsm-dev libsndfile1 libthai-data Step #0 - "docker-build": libthai0 libtiff5 libvorbis0a libvorbisenc2 libwebp6 libwrap0 libx11-dev Step #0 - "docker-build": libxau-dev libxcb-render0 libxcb1-dev libxcursor1 libxdamage1 libxdmcp-dev Step #0 - "docker-build": libxt-dev openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless Step #0 - "docker-build": ubuntu-mono unzip x11proto-core-dev x11proto-dev xorg-sgml-doctools Step #0 - "docker-build": xtrans-dev Step #0 - "docker-build": Suggested packages: Step #0 - "docker-build": bash-completion g++-multilib gcc-multilib autoconf automake libtool flex Step #0 - "docker-build": bison gdb gcc-doc gvfs libice-doc pulseaudio librsvg2-bin libsm-doc Step #0 - "docker-build": libx11-doc libxcb-doc libxt-doc openjdk-8-demo openjdk-8-source visualvm Step #0 - "docker-build": libnss-mdns fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei Step #0 - "docker-build": fonts-wqy-zenhei fonts-indic zip Step #0 - "docker-build": The following NEW packages will be installed: Step #0 - "docker-build": adwaita-icon-theme bazel fontconfig g++ gcc gtk-update-icon-cache Step #0 - "docker-build": hicolor-icon-theme humanity-icon-theme libasyncns0 libcairo-gobject2 Step #0 - "docker-build": libcairo2 libdatrie1 libflac8 libfribidi0 libgail-common libgail18 Step #0 - "docker-build": libgdk-pixbuf2.0-0 libgdk-pixbuf2.0-bin libgdk-pixbuf2.0-common libgtk2.0-0 Step #0 - "docker-build": libgtk2.0-bin libgtk2.0-common libice-dev libjbig0 libogg0 libpango-1.0-0 Step #0 - "docker-build": libpangocairo-1.0-0 libpangoft2-1.0-0 libpixman-1-0 libpthread-stubs0-dev Step #0 - "docker-build": libpulse0 librsvg2-2 librsvg2-common libsm-dev libsndfile1 libthai-data Step #0 - "docker-build": libthai0 libtiff5 libvorbis0a libvorbisenc2 libwebp6 libwrap0 libx11-dev Step #0 - "docker-build": libxau-dev libxcb-render0 libxcb1-dev libxcursor1 libxdamage1 libxdmcp-dev Step #0 - "docker-build": libxt-dev openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre Step #0 - "docker-build": openjdk-8-jre-headless ubuntu-mono unzip x11proto-core-dev x11proto-dev Step #0 - "docker-build": xorg-sgml-doctools xtrans-dev Step #0 - "docker-build": 0 upgraded, 60 newly installed, 0 to remove and 20 not upgraded. Step #0 - "docker-build": Need to get 103 MB of archives. Step #0 - "docker-build": After this operation, 215 MB of additional disk space will be used. Step #0 - "docker-build": Get:1 http://storage.googleapis.com/bazel-apt stable/jdk1.8 amd64 bazel amd64 5.3.2 [48.6 MB] Step #0 - "docker-build": Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libfribidi0 amd64 1.0.8-2ubuntu0.1 [24.2 kB] Step #0 - "docker-build": Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 hicolor-icon-theme all 0.17-2 [9976 B] Step #0 - "docker-build": Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjbig0 amd64 2.1-3.1ubuntu0.20.04.1 [27.3 kB] Step #0 - "docker-build": Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libwebp6 amd64 0.6.1-2ubuntu0.20.04.1 [185 kB] Step #0 - "docker-build": Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libtiff5 amd64 4.1.0+git191117-2ubuntu0.20.04.7 [163 kB] Step #0 - "docker-build": Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libgdk-pixbuf2.0-common all 2.40.0+dfsg-3ubuntu0.4 [4592 B] Step #0 - "docker-build": Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libgdk-pixbuf2.0-0 amd64 2.40.0+dfsg-3ubuntu0.4 [168 kB] Step #0 - "docker-build": Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 gtk-update-icon-cache amd64 3.24.20-0ubuntu1.1 [28.8 kB] Step #0 - "docker-build": Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpixman-1-0 amd64 0.38.4-0ubuntu2.1 [227 kB] Step #0 - "docker-build": Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libxcb-render0 amd64 1.14-2 [14.8 kB] Step #0 - "docker-build": Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 libcairo2 amd64 1.16.0-4ubuntu1 [583 kB] Step #0 - "docker-build": Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 libcairo-gobject2 amd64 1.16.0-4ubuntu1 [17.2 kB] Step #0 - "docker-build": Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 fontconfig amd64 2.13.1-2ubuntu3 [171 kB] Step #0 - "docker-build": Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 libthai-data all 0.1.28-3 [134 kB] Step #0 - "docker-build": Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libdatrie1 amd64 0.2.12-3 [18.7 kB] Step #0 - "docker-build": Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libthai0 amd64 0.1.28-3 [18.1 kB] Step #0 - "docker-build": Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 libpango-1.0-0 amd64 1.44.7-2ubuntu4 [162 kB] Step #0 - "docker-build": Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libpangoft2-1.0-0 amd64 1.44.7-2ubuntu4 [34.9 kB] Step #0 - "docker-build": Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 libpangocairo-1.0-0 amd64 1.44.7-2ubuntu4 [24.8 kB] Step #0 - "docker-build": Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librsvg2-2 amd64 2.48.9-1ubuntu0.20.04.1 [2253 kB] Step #0 - "docker-build": Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librsvg2-common amd64 2.48.9-1ubuntu0.20.04.1 [9212 B] Step #0 - "docker-build": Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 humanity-icon-theme all 0.6.15 [1250 kB] Step #0 - "docker-build": Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 ubuntu-mono all 19.04-0ubuntu3 [147 kB] Step #0 - "docker-build": Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 adwaita-icon-theme all 3.36.1-2ubuntu0.20.04.2 [3441 kB] Step #0 - "docker-build": Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 gcc amd64 4:9.3.0-1ubuntu2 [5208 B] Step #0 - "docker-build": Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 g++ amd64 4:9.3.0-1ubuntu2 [1604 B] Step #0 - "docker-build": Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 unzip amd64 6.0-25ubuntu1.1 [168 kB] Step #0 - "docker-build": Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 libasyncns0 amd64 0.8-6 [12.1 kB] Step #0 - "docker-build": Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 libogg0 amd64 1.3.4-0ubuntu1 [24.0 kB] Step #0 - "docker-build": Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libflac8 amd64 1.3.3-1ubuntu0.1 [103 kB] Step #0 - "docker-build": Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libgtk2.0-common all 2.24.32-4ubuntu4 [126 kB] Step #0 - "docker-build": Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 libxcursor1 amd64 1:1.2.0-2 [20.1 kB] Step #0 - "docker-build": Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 libxdamage1 amd64 1:1.1.5-2 [6996 B] Step #0 - "docker-build": Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 libgtk2.0-0 amd64 2.24.32-4ubuntu4 [1791 kB] Step #0 - "docker-build": Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libgail18 amd64 2.24.32-4ubuntu4 [14.7 kB] Step #0 - "docker-build": Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 libgail-common amd64 2.24.32-4ubuntu4 [116 kB] Step #0 - "docker-build": Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libgdk-pixbuf2.0-bin amd64 2.40.0+dfsg-3ubuntu0.4 [14.1 kB] Step #0 - "docker-build": Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 libgtk2.0-bin amd64 2.24.32-4ubuntu4 [7728 B] Step #0 - "docker-build": Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 xorg-sgml-doctools all 1:1.11-1 [12.9 kB] Step #0 - "docker-build": Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 x11proto-dev all 2019.2-1ubuntu1 [594 kB] Step #0 - "docker-build": Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 x11proto-core-dev all 2019.2-1ubuntu1 [2620 B] Step #0 - "docker-build": Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libice-dev amd64 2:1.0.10-0ubuntu1 [47.8 kB] Step #0 - "docker-build": Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 libpthread-stubs0-dev amd64 0.4-1 [5384 B] Step #0 - "docker-build": Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libvorbis0a amd64 1.3.6-2ubuntu1 [87.0 kB] Step #0 - "docker-build": Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 libvorbisenc2 amd64 1.3.6-2ubuntu1 [70.7 kB] Step #0 - "docker-build": Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsndfile1 amd64 1.0.28-7ubuntu0.1 [170 kB] Step #0 - "docker-build": Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 libwrap0 amd64 7.6.q-30 [46.3 kB] Step #0 - "docker-build": Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpulse0 amd64 1:13.99.1-1ubuntu3.13 [262 kB] Step #0 - "docker-build": Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libsm-dev amd64 2:1.2.3-1 [17.0 kB] Step #0 - "docker-build": Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 libxau-dev amd64 1:1.0.9-0ubuntu1 [9552 B] Step #0 - "docker-build": Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 libxdmcp-dev amd64 1:1.1.3-0ubuntu1 [25.3 kB] Step #0 - "docker-build": Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 xtrans-dev all 1.4.0-1 [68.9 kB] Step #0 - "docker-build": Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libxcb1-dev amd64 1.14-2 [80.5 kB] Step #0 - "docker-build": Get:55 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libx11-dev amd64 2:1.6.9-2ubuntu1.2 [647 kB] Step #0 - "docker-build": Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 libxt-dev amd64 1:1.1.5-1 [395 kB] Step #0 - "docker-build": Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 openjdk-8-jre-headless amd64 8u352-ga-1~20.04 [28.2 MB] Step #0 - "docker-build": Get:58 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 openjdk-8-jre amd64 8u352-ga-1~20.04 [69.9 kB] Step #0 - "docker-build": Get:59 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 openjdk-8-jdk-headless amd64 8u352-ga-1~20.04 [8293 kB] Step #0 - "docker-build": Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 openjdk-8-jdk amd64 8u352-ga-1~20.04 [4015 kB] Step #0 - "docker-build": debconf: delaying package configuration, since apt-utils is not installed Step #0 - "docker-build": Fetched 103 MB in 4s (29.4 MB/s) Step #0 - "docker-build": Selecting previously unselected package libfribidi0:amd64. Step #0 - "docker-build": (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 23094 files and directories currently installed.) Step #0 - "docker-build": Preparing to unpack .../00-libfribidi0_1.0.8-2ubuntu0.1_amd64.deb ... Step #0 - "docker-build": Unpacking libfribidi0:amd64 (1.0.8-2ubuntu0.1) ... Step #0 - "docker-build": Selecting previously unselected package hicolor-icon-theme. Step #0 - "docker-build": Preparing to unpack .../01-hicolor-icon-theme_0.17-2_all.deb ... Step #0 - "docker-build": Unpacking hicolor-icon-theme (0.17-2) ... Step #0 - "docker-build": Selecting previously unselected package libjbig0:amd64. Step #0 - "docker-build": Preparing to unpack .../02-libjbig0_2.1-3.1ubuntu0.20.04.1_amd64.deb ... Step #0 - "docker-build": Unpacking libjbig0:amd64 (2.1-3.1ubuntu0.20.04.1) ... Step #0 - "docker-build": Selecting previously unselected package libwebp6:amd64. Step #0 - "docker-build": Preparing to unpack .../03-libwebp6_0.6.1-2ubuntu0.20.04.1_amd64.deb ... Step #0 - "docker-build": Unpacking libwebp6:amd64 (0.6.1-2ubuntu0.20.04.1) ... Step #0 - "docker-build": Selecting previously unselected package libtiff5:amd64. Step #0 - "docker-build": Preparing to unpack .../04-libtiff5_4.1.0+git191117-2ubuntu0.20.04.7_amd64.deb ... Step #0 - "docker-build": Unpacking libtiff5:amd64 (4.1.0+git191117-2ubuntu0.20.04.7) ... Step #0 - "docker-build": Selecting previously unselected package libgdk-pixbuf2.0-common. Step #0 - "docker-build": Preparing to unpack .../05-libgdk-pixbuf2.0-common_2.40.0+dfsg-3ubuntu0.4_all.deb ... Step #0 - "docker-build": Unpacking libgdk-pixbuf2.0-common (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Selecting previously unselected package libgdk-pixbuf2.0-0:amd64. Step #0 - "docker-build": Preparing to unpack .../06-libgdk-pixbuf2.0-0_2.40.0+dfsg-3ubuntu0.4_amd64.deb ... Step #0 - "docker-build": Unpacking libgdk-pixbuf2.0-0:amd64 (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Selecting previously unselected package gtk-update-icon-cache. Step #0 - "docker-build": Preparing to unpack .../07-gtk-update-icon-cache_3.24.20-0ubuntu1.1_amd64.deb ... Step #0 - "docker-build": No diversion 'diversion of /usr/sbin/update-icon-caches to /usr/sbin/update-icon-caches.gtk2 by libgtk-3-bin', none removed. Step #0 - "docker-build": No diversion 'diversion of /usr/share/man/man8/update-icon-caches.8.gz to /usr/share/man/man8/update-icon-caches.gtk2.8.gz by libgtk-3-bin', none removed. Step #0 - "docker-build": Unpacking gtk-update-icon-cache (3.24.20-0ubuntu1.1) ... Step #0 - "docker-build": Selecting previously unselected package libpixman-1-0:amd64. Step #0 - "docker-build": Preparing to unpack .../08-libpixman-1-0_0.38.4-0ubuntu2.1_amd64.deb ... Step #0 - "docker-build": Unpacking libpixman-1-0:amd64 (0.38.4-0ubuntu2.1) ... Step #0 - "docker-build": Selecting previously unselected package libxcb-render0:amd64. Step #0 - "docker-build": Preparing to unpack .../09-libxcb-render0_1.14-2_amd64.deb ... Step #0 - "docker-build": Unpacking libxcb-render0:amd64 (1.14-2) ... Step #0 - "docker-build": Selecting previously unselected package libcairo2:amd64. Step #0 - "docker-build": Preparing to unpack .../10-libcairo2_1.16.0-4ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libcairo2:amd64 (1.16.0-4ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libcairo-gobject2:amd64. Step #0 - "docker-build": Preparing to unpack .../11-libcairo-gobject2_1.16.0-4ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libcairo-gobject2:amd64 (1.16.0-4ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package fontconfig. Step #0 - "docker-build": Preparing to unpack .../12-fontconfig_2.13.1-2ubuntu3_amd64.deb ... Step #0 - "docker-build": Unpacking fontconfig (2.13.1-2ubuntu3) ... Step #0 - "docker-build": Selecting previously unselected package libthai-data. Step #0 - "docker-build": Preparing to unpack .../13-libthai-data_0.1.28-3_all.deb ... Step #0 - "docker-build": Unpacking libthai-data (0.1.28-3) ... Step #0 - "docker-build": Selecting previously unselected package libdatrie1:amd64. Step #0 - "docker-build": Preparing to unpack .../14-libdatrie1_0.2.12-3_amd64.deb ... Step #0 - "docker-build": Unpacking libdatrie1:amd64 (0.2.12-3) ... Step #0 - "docker-build": Selecting previously unselected package libthai0:amd64. Step #0 - "docker-build": Preparing to unpack .../15-libthai0_0.1.28-3_amd64.deb ... Step #0 - "docker-build": Unpacking libthai0:amd64 (0.1.28-3) ... Step #0 - "docker-build": Selecting previously unselected package libpango-1.0-0:amd64. Step #0 - "docker-build": Preparing to unpack .../16-libpango-1.0-0_1.44.7-2ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libpango-1.0-0:amd64 (1.44.7-2ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package libpangoft2-1.0-0:amd64. Step #0 - "docker-build": Preparing to unpack .../17-libpangoft2-1.0-0_1.44.7-2ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libpangoft2-1.0-0:amd64 (1.44.7-2ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package libpangocairo-1.0-0:amd64. Step #0 - "docker-build": Preparing to unpack .../18-libpangocairo-1.0-0_1.44.7-2ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libpangocairo-1.0-0:amd64 (1.44.7-2ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package librsvg2-2:amd64. Step #0 - "docker-build": Preparing to unpack .../19-librsvg2-2_2.48.9-1ubuntu0.20.04.1_amd64.deb ... Step #0 - "docker-build": Unpacking librsvg2-2:amd64 (2.48.9-1ubuntu0.20.04.1) ... Step #0 - "docker-build": Selecting previously unselected package librsvg2-common:amd64. Step #0 - "docker-build": Preparing to unpack .../20-librsvg2-common_2.48.9-1ubuntu0.20.04.1_amd64.deb ... Step #0 - "docker-build": Unpacking librsvg2-common:amd64 (2.48.9-1ubuntu0.20.04.1) ... Step #0 - "docker-build": Selecting previously unselected package humanity-icon-theme. Step #0 - "docker-build": Preparing to unpack .../21-humanity-icon-theme_0.6.15_all.deb ... Step #0 - "docker-build": Unpacking humanity-icon-theme (0.6.15) ... Step #0 - "docker-build": Selecting previously unselected package ubuntu-mono. Step #0 - "docker-build": Preparing to unpack .../22-ubuntu-mono_19.04-0ubuntu3_all.deb ... Step #0 - "docker-build": Unpacking ubuntu-mono (19.04-0ubuntu3) ... Step #0 - "docker-build": Selecting previously unselected package adwaita-icon-theme. Step #0 - "docker-build": Preparing to unpack .../23-adwaita-icon-theme_3.36.1-2ubuntu0.20.04.2_all.deb ... Step #0 - "docker-build": Unpacking adwaita-icon-theme (3.36.1-2ubuntu0.20.04.2) ... Step #0 - "docker-build": Selecting previously unselected package gcc. Step #0 - "docker-build": Preparing to unpack .../24-gcc_4%3a9.3.0-1ubuntu2_amd64.deb ... Step #0 - "docker-build": Unpacking gcc (4:9.3.0-1ubuntu2) ... Step #0 - "docker-build": Selecting previously unselected package g++. Step #0 - "docker-build": Preparing to unpack .../25-g++_4%3a9.3.0-1ubuntu2_amd64.deb ... Step #0 - "docker-build": Unpacking g++ (4:9.3.0-1ubuntu2) ... Step #0 - "docker-build": Selecting previously unselected package unzip. Step #0 - "docker-build": Preparing to unpack .../26-unzip_6.0-25ubuntu1.1_amd64.deb ... Step #0 - "docker-build": Unpacking unzip (6.0-25ubuntu1.1) ... Step #0 - "docker-build": Selecting previously unselected package bazel. Step #0 - "docker-build": Preparing to unpack .../27-bazel_5.3.2_amd64.deb ... Step #0 - "docker-build": Unpacking bazel (5.3.2) ... Step #0 - "docker-build": Selecting previously unselected package libasyncns0:amd64. Step #0 - "docker-build": Preparing to unpack .../28-libasyncns0_0.8-6_amd64.deb ... Step #0 - "docker-build": Unpacking libasyncns0:amd64 (0.8-6) ... Step #0 - "docker-build": Selecting previously unselected package libogg0:amd64. Step #0 - "docker-build": Preparing to unpack .../29-libogg0_1.3.4-0ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libogg0:amd64 (1.3.4-0ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libflac8:amd64. Step #0 - "docker-build": Preparing to unpack .../30-libflac8_1.3.3-1ubuntu0.1_amd64.deb ... Step #0 - "docker-build": Unpacking libflac8:amd64 (1.3.3-1ubuntu0.1) ... Step #0 - "docker-build": Selecting previously unselected package libgtk2.0-common. Step #0 - "docker-build": Preparing to unpack .../31-libgtk2.0-common_2.24.32-4ubuntu4_all.deb ... Step #0 - "docker-build": Unpacking libgtk2.0-common (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package libxcursor1:amd64. Step #0 - "docker-build": Preparing to unpack .../32-libxcursor1_1%3a1.2.0-2_amd64.deb ... Step #0 - "docker-build": Unpacking libxcursor1:amd64 (1:1.2.0-2) ... Step #0 - "docker-build": Selecting previously unselected package libxdamage1:amd64. Step #0 - "docker-build": Preparing to unpack .../33-libxdamage1_1%3a1.1.5-2_amd64.deb ... Step #0 - "docker-build": Unpacking libxdamage1:amd64 (1:1.1.5-2) ... Step #0 - "docker-build": Selecting previously unselected package libgtk2.0-0:amd64. Step #0 - "docker-build": Preparing to unpack .../34-libgtk2.0-0_2.24.32-4ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libgtk2.0-0:amd64 (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package libgail18:amd64. Step #0 - "docker-build": Preparing to unpack .../35-libgail18_2.24.32-4ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libgail18:amd64 (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package libgail-common:amd64. Step #0 - "docker-build": Preparing to unpack .../36-libgail-common_2.24.32-4ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libgail-common:amd64 (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package libgdk-pixbuf2.0-bin. Step #0 - "docker-build": Preparing to unpack .../37-libgdk-pixbuf2.0-bin_2.40.0+dfsg-3ubuntu0.4_amd64.deb ... Step #0 - "docker-build": Unpacking libgdk-pixbuf2.0-bin (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Selecting previously unselected package libgtk2.0-bin. Step #0 - "docker-build": Preparing to unpack .../38-libgtk2.0-bin_2.24.32-4ubuntu4_amd64.deb ... Step #0 - "docker-build": Unpacking libgtk2.0-bin (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Selecting previously unselected package xorg-sgml-doctools. Step #0 - "docker-build": Preparing to unpack .../39-xorg-sgml-doctools_1%3a1.11-1_all.deb ... Step #0 - "docker-build": Unpacking xorg-sgml-doctools (1:1.11-1) ... Step #0 - "docker-build": Selecting previously unselected package x11proto-dev. Step #0 - "docker-build": Preparing to unpack .../40-x11proto-dev_2019.2-1ubuntu1_all.deb ... Step #0 - "docker-build": Unpacking x11proto-dev (2019.2-1ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package x11proto-core-dev. Step #0 - "docker-build": Preparing to unpack .../41-x11proto-core-dev_2019.2-1ubuntu1_all.deb ... Step #0 - "docker-build": Unpacking x11proto-core-dev (2019.2-1ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libice-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../42-libice-dev_2%3a1.0.10-0ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libice-dev:amd64 (2:1.0.10-0ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libpthread-stubs0-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../43-libpthread-stubs0-dev_0.4-1_amd64.deb ... Step #0 - "docker-build": Unpacking libpthread-stubs0-dev:amd64 (0.4-1) ... Step #0 - "docker-build": Selecting previously unselected package libvorbis0a:amd64. Step #0 - "docker-build": Preparing to unpack .../44-libvorbis0a_1.3.6-2ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libvorbis0a:amd64 (1.3.6-2ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libvorbisenc2:amd64. Step #0 - "docker-build": Preparing to unpack .../45-libvorbisenc2_1.3.6-2ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libvorbisenc2:amd64 (1.3.6-2ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libsndfile1:amd64. Step #0 - "docker-build": Preparing to unpack .../46-libsndfile1_1.0.28-7ubuntu0.1_amd64.deb ... Step #0 - "docker-build": Unpacking libsndfile1:amd64 (1.0.28-7ubuntu0.1) ... Step #0 - "docker-build": Selecting previously unselected package libwrap0:amd64. Step #0 - "docker-build": Preparing to unpack .../47-libwrap0_7.6.q-30_amd64.deb ... Step #0 - "docker-build": Unpacking libwrap0:amd64 (7.6.q-30) ... Step #0 - "docker-build": Selecting previously unselected package libpulse0:amd64. Step #0 - "docker-build": Preparing to unpack .../48-libpulse0_1%3a13.99.1-1ubuntu3.13_amd64.deb ... Step #0 - "docker-build": Unpacking libpulse0:amd64 (1:13.99.1-1ubuntu3.13) ... Step #0 - "docker-build": Selecting previously unselected package libsm-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../49-libsm-dev_2%3a1.2.3-1_amd64.deb ... Step #0 - "docker-build": Unpacking libsm-dev:amd64 (2:1.2.3-1) ... Step #0 - "docker-build": Selecting previously unselected package libxau-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../50-libxau-dev_1%3a1.0.9-0ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libxau-dev:amd64 (1:1.0.9-0ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package libxdmcp-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../51-libxdmcp-dev_1%3a1.1.3-0ubuntu1_amd64.deb ... Step #0 - "docker-build": Unpacking libxdmcp-dev:amd64 (1:1.1.3-0ubuntu1) ... Step #0 - "docker-build": Selecting previously unselected package xtrans-dev. Step #0 - "docker-build": Preparing to unpack .../52-xtrans-dev_1.4.0-1_all.deb ... Step #0 - "docker-build": Unpacking xtrans-dev (1.4.0-1) ... Step #0 - "docker-build": Selecting previously unselected package libxcb1-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../53-libxcb1-dev_1.14-2_amd64.deb ... Step #0 - "docker-build": Unpacking libxcb1-dev:amd64 (1.14-2) ... Step #0 - "docker-build": Selecting previously unselected package libx11-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../54-libx11-dev_2%3a1.6.9-2ubuntu1.2_amd64.deb ... Step #0 - "docker-build": Unpacking libx11-dev:amd64 (2:1.6.9-2ubuntu1.2) ... Step #0 - "docker-build": Selecting previously unselected package libxt-dev:amd64. Step #0 - "docker-build": Preparing to unpack .../55-libxt-dev_1%3a1.1.5-1_amd64.deb ... Step #0 - "docker-build": Unpacking libxt-dev:amd64 (1:1.1.5-1) ... Step #0 - "docker-build": Selecting previously unselected package openjdk-8-jre-headless:amd64. Step #0 - "docker-build": Preparing to unpack .../56-openjdk-8-jre-headless_8u352-ga-1~20.04_amd64.deb ... Step #0 - "docker-build": Unpacking openjdk-8-jre-headless:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": Selecting previously unselected package openjdk-8-jre:amd64. Step #0 - "docker-build": Preparing to unpack .../57-openjdk-8-jre_8u352-ga-1~20.04_amd64.deb ... Step #0 - "docker-build": Unpacking openjdk-8-jre:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": Selecting previously unselected package openjdk-8-jdk-headless:amd64. Step #0 - "docker-build": Preparing to unpack .../58-openjdk-8-jdk-headless_8u352-ga-1~20.04_amd64.deb ... Step #0 - "docker-build": Unpacking openjdk-8-jdk-headless:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": Selecting previously unselected package openjdk-8-jdk:amd64. Step #0 - "docker-build": Preparing to unpack .../59-openjdk-8-jdk_8u352-ga-1~20.04_amd64.deb ... Step #0 - "docker-build": Unpacking openjdk-8-jdk:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": Setting up libpixman-1-0:amd64 (0.38.4-0ubuntu2.1) ... Step #0 - "docker-build": Setting up fontconfig (2.13.1-2ubuntu3) ... Step #0 - "docker-build": Regenerating fonts cache... done. Step #0 - "docker-build": Setting up libxdamage1:amd64 (1:1.1.5-2) ... Step #0 - "docker-build": Setting up libogg0:amd64 (1.3.4-0ubuntu1) ... Step #0 - "docker-build": Setting up hicolor-icon-theme (0.17-2) ... Step #0 - "docker-build": Setting up libdatrie1:amd64 (0.2.12-3) ... Step #0 - "docker-build": Setting up libxcb-render0:amd64 (1.14-2) ... Step #0 - "docker-build": Setting up unzip (6.0-25ubuntu1.1) ... Step #0 - "docker-build": Setting up libxcursor1:amd64 (1:1.2.0-2) ... Step #0 - "docker-build": Setting up libgdk-pixbuf2.0-common (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Setting up libpthread-stubs0-dev:amd64 (0.4-1) ... Step #0 - "docker-build": Setting up libjbig0:amd64 (2.1-3.1ubuntu0.20.04.1) ... Step #0 - "docker-build": Setting up libcairo2:amd64 (1.16.0-4ubuntu1) ... Step #0 - "docker-build": Setting up gcc (4:9.3.0-1ubuntu2) ... Step #0 - "docker-build": Setting up libflac8:amd64 (1.3.3-1ubuntu0.1) ... Step #0 - "docker-build": Setting up xtrans-dev (1.4.0-1) ... Step #0 - "docker-build": Setting up libwrap0:amd64 (7.6.q-30) ... Step #0 - "docker-build": Setting up libfribidi0:amd64 (1.0.8-2ubuntu0.1) ... Step #0 - "docker-build": Setting up openjdk-8-jre-headless:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode Step #0 - "docker-build": Setting up libvorbis0a:amd64 (1.3.6-2ubuntu1) ... Step #0 - "docker-build": Setting up libwebp6:amd64 (0.6.1-2ubuntu0.20.04.1) ... Step #0 - "docker-build": Setting up g++ (4:9.3.0-1ubuntu2) ... Step #0 - "docker-build": update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode Step #0 - "docker-build": update-alternatives: warning: skip creation of /usr/share/man/man1/c++.1.gz because associated file /usr/share/man/man1/g++.1.gz (of link group c++) doesn't exist Step #0 - "docker-build": Setting up libasyncns0:amd64 (0.8-6) ... Step #0 - "docker-build": Setting up bazel (5.3.2) ... Step #0 - "docker-build": Setting up libthai-data (0.1.28-3) ... Step #0 - "docker-build": Setting up xorg-sgml-doctools (1:1.11-1) ... Step #0 - "docker-build": Setting up libcairo-gobject2:amd64 (1.16.0-4ubuntu1) ... Step #0 - "docker-build": Setting up libgtk2.0-common (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Setting up libtiff5:amd64 (4.1.0+git191117-2ubuntu0.20.04.7) ... Step #0 - "docker-build": Setting up libvorbisenc2:amd64 (1.3.6-2ubuntu1) ... Step #0 - "docker-build": Setting up x11proto-dev (2019.2-1ubuntu1) ... Step #0 - "docker-build": Setting up libxau-dev:amd64 (1:1.0.9-0ubuntu1) ... Step #0 - "docker-build": Setting up libice-dev:amd64 (2:1.0.10-0ubuntu1) ... Step #0 - "docker-build": Setting up libsm-dev:amd64 (2:1.2.3-1) ... Step #0 - "docker-build": Setting up libthai0:amd64 (0.1.28-3) ... Step #0 - "docker-build": Setting up libxdmcp-dev:amd64 (1:1.1.3-0ubuntu1) ... Step #0 - "docker-build": Setting up openjdk-8-jdk-headless:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jdeps to provide /usr/bin/jdeps (jdeps) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/rmic to provide /usr/bin/rmic (rmic) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jinfo to provide /usr/bin/jinfo (jinfo) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jstat to provide /usr/bin/jstat (jstat) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javac to provide /usr/bin/javac (javac) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jstack to provide /usr/bin/jstack (jstack) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jrunscript to provide /usr/bin/jrunscript (jrunscript) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javadoc to provide /usr/bin/javadoc (javadoc) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javap to provide /usr/bin/javap (javap) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jar to provide /usr/bin/jar (jar) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jps to provide /usr/bin/jps (jps) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jmap to provide /usr/bin/jmap (jmap) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jstatd to provide /usr/bin/jstatd (jstatd) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jdb to provide /usr/bin/jdb (jdb) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/serialver to provide /usr/bin/serialver (serialver) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jfr to provide /usr/bin/jfr (jfr) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jcmd to provide /usr/bin/jcmd (jcmd) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jarsigner to provide /usr/bin/jarsigner (jarsigner) in auto mode Step #0 - "docker-build": Setting up x11proto-core-dev (2019.2-1ubuntu1) ... Step #0 - "docker-build": Setting up libgdk-pixbuf2.0-0:amd64 (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Setting up libgdk-pixbuf2.0-bin (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Setting up libsndfile1:amd64 (1.0.28-7ubuntu0.1) ... Step #0 - "docker-build": Setting up gtk-update-icon-cache (3.24.20-0ubuntu1.1) ... Step #0 - "docker-build": Setting up libxcb1-dev:amd64 (1.14-2) ... Step #0 - "docker-build": Setting up libpulse0:amd64 (1:13.99.1-1ubuntu3.13) ... Step #0 - "docker-build": Setting up libpango-1.0-0:amd64 (1.44.7-2ubuntu4) ... Step #0 - "docker-build": Setting up libx11-dev:amd64 (2:1.6.9-2ubuntu1.2) ... Step #0 - "docker-build": Setting up libxt-dev:amd64 (1:1.1.5-1) ... Step #0 - "docker-build": Setting up libpangoft2-1.0-0:amd64 (1.44.7-2ubuntu4) ... Step #0 - "docker-build": Setting up libpangocairo-1.0-0:amd64 (1.44.7-2ubuntu4) ... Step #0 - "docker-build": Setting up librsvg2-2:amd64 (2.48.9-1ubuntu0.20.04.1) ... Step #0 - "docker-build": Setting up librsvg2-common:amd64 (2.48.9-1ubuntu0.20.04.1) ... Step #0 - "docker-build": Setting up adwaita-icon-theme (3.36.1-2ubuntu0.20.04.2) ... Step #0 - "docker-build": update-alternatives: using /usr/share/icons/Adwaita/cursor.theme to provide /usr/share/icons/default/index.theme (x-cursor-theme) in auto mode Step #0 - "docker-build": Setting up libgtk2.0-0:amd64 (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Setting up openjdk-8-jre:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode Step #0 - "docker-build": Setting up humanity-icon-theme (0.6.15) ... Step #0 - "docker-build": Setting up libgail18:amd64 (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Setting up libgtk2.0-bin (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Setting up openjdk-8-jdk:amd64 (8u352-ga-1~20.04) ... Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode Step #0 - "docker-build": update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jconsole to provide /usr/bin/jconsole (jconsole) in auto mode Step #0 - "docker-build": Setting up libgail-common:amd64 (2.24.32-4ubuntu4) ... Step #0 - "docker-build": Setting up ubuntu-mono (19.04-0ubuntu3) ... Step #0 - "docker-build": Processing triggers for mime-support (3.64ubuntu1) ... Step #0 - "docker-build": Processing triggers for libc-bin (2.31-0ubuntu9.9) ... Step #0 - "docker-build": Processing triggers for libgdk-pixbuf2.0-0:amd64 (2.40.0+dfsg-3ubuntu0.4) ... Step #0 - "docker-build": Removing intermediate container 3c26291d20fb Step #0 - "docker-build": ---> da9e01982627 Step #0 - "docker-build": Step 7/7 : USER ia-tests Step #0 - "docker-build": ---> Running in c9538e2cb3a4 Step #0 - "docker-build": Removing intermediate container c9538e2cb3a4 Step #0 - "docker-build": ---> 95544d9638ff Step #0 - "docker-build": Successfully built 95544d9638ff Step #0 - "docker-build": Successfully tagged gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Finished Step #0 - "docker-build" Starting Step #1 - "gcr-push" Step #1 - "gcr-push": Already have image (with digest): gcr.io/cloud-builders/docker Step #1 - "gcr-push": The push refers to repository [gcr.io/cloud-dataproc-ci/init-actions-image] Step #1 - "gcr-push": 2dba2a6add06: Preparing Step #1 - "gcr-push": f282d91648c2: Preparing Step #1 - "gcr-push": d8e3961eca43: Preparing Step #1 - "gcr-push": 79e66282406c: Preparing Step #1 - "gcr-push": 7c885943da96: Preparing Step #1 - "gcr-push": 34b29c06e2a4: Preparing Step #1 - "gcr-push": 107052f7aa66: Preparing Step #1 - "gcr-push": 17bce1d684cb: Preparing Step #1 - "gcr-push": cc165d844429: Preparing Step #1 - "gcr-push": 84ff92691f90: Preparing Step #1 - "gcr-push": ee8b91b84a55: Preparing Step #1 - "gcr-push": 5966dbefee94: Preparing Step #1 - "gcr-push": 34b29c06e2a4: Waiting Step #1 - "gcr-push": 107052f7aa66: Waiting Step #1 - "gcr-push": 17bce1d684cb: Waiting Step #1 - "gcr-push": cc165d844429: Waiting Step #1 - "gcr-push": 84ff92691f90: Waiting Step #1 - "gcr-push": ee8b91b84a55: Waiting Step #1 - "gcr-push": 5966dbefee94: Waiting Step #1 - "gcr-push": f282d91648c2: Pushed Step #1 - "gcr-push": d8e3961eca43: Pushed Step #1 - "gcr-push": 7c885943da96: Pushed Step #1 - "gcr-push": 34b29c06e2a4: Layer already exists Step #1 - "gcr-push": 107052f7aa66: Layer already exists Step #1 - "gcr-push": 17bce1d684cb: Layer already exists Step #1 - "gcr-push": cc165d844429: Layer already exists Step #1 - "gcr-push": 84ff92691f90: Layer already exists Step #1 - "gcr-push": ee8b91b84a55: Layer already exists Step #1 - "gcr-push": 5966dbefee94: Layer already exists Step #1 - "gcr-push": 79e66282406c: Pushed Step #1 - "gcr-push": 2dba2a6add06: Pushed Step #1 - "gcr-push": 0bf75426-6e63-48ba-bd59-6306458e9170: digest: sha256:1b4252c4172111741199f394c209078c4d02199c01fa9a0eedd461c37aa6623a size: 2835 Finished Step #1 - "gcr-push" Starting Step #2 - "dataproc-1.5-debian10-tests" Starting Step #7 - "dataproc-2.0-ubuntu18-tests" Starting Step #6 - "dataproc-2.0-rocky8-tests" Starting Step #5 - "dataproc-2.0-debian10-tests" Starting Step #4 - "dataproc-1.5-ubuntu18-tests" Starting Step #3 - "dataproc-1.5-rocky8-tests" Step #7 - "dataproc-2.0-ubuntu18-tests": Already have image (with digest): gcr.io/cloud-builders/kubectl Step #2 - "dataproc-1.5-debian10-tests": Already have image (with digest): gcr.io/cloud-builders/kubectl Step #6 - "dataproc-2.0-rocky8-tests": Already have image (with digest): gcr.io/cloud-builders/kubectl Step #3 - "dataproc-1.5-rocky8-tests": Already have image (with digest): gcr.io/cloud-builders/kubectl Step #4 - "dataproc-1.5-ubuntu18-tests": Already have image (with digest): gcr.io/cloud-builders/kubectl Step #5 - "dataproc-2.0-debian10-tests": Already have image (with digest): gcr.io/cloud-builders/kubectl Step #5 - "dataproc-2.0-debian10-tests": + readonly IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + readonly BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + readonly DATAPROC_IMAGE_VERSION=2.0-debian10 Step #5 - "dataproc-2.0-debian10-tests": + DATAPROC_IMAGE_VERSION=2.0-debian10 Step #5 - "dataproc-2.0-debian10-tests": + readonly POD_NAME=presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + POD_NAME=presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + gcloud container clusters get-credentials init-actions-presubmit Step #3 - "dataproc-1.5-rocky8-tests": + readonly IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + readonly BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + readonly DATAPROC_IMAGE_VERSION=1.5-rocky8 Step #3 - "dataproc-1.5-rocky8-tests": + DATAPROC_IMAGE_VERSION=1.5-rocky8 Step #3 - "dataproc-1.5-rocky8-tests": + readonly POD_NAME=presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + POD_NAME=presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + gcloud container clusters get-credentials init-actions-presubmit Step #2 - "dataproc-1.5-debian10-tests": + readonly IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + readonly BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + readonly DATAPROC_IMAGE_VERSION=1.5-debian10 Step #2 - "dataproc-1.5-debian10-tests": + DATAPROC_IMAGE_VERSION=1.5-debian10 Step #2 - "dataproc-1.5-debian10-tests": + readonly POD_NAME=presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + POD_NAME=presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + gcloud container clusters get-credentials init-actions-presubmit Step #6 - "dataproc-2.0-rocky8-tests": + readonly IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + readonly BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + readonly DATAPROC_IMAGE_VERSION=2.0-rocky8 Step #6 - "dataproc-2.0-rocky8-tests": + DATAPROC_IMAGE_VERSION=2.0-rocky8 Step #6 - "dataproc-2.0-rocky8-tests": + readonly POD_NAME=presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + POD_NAME=presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + gcloud container clusters get-credentials init-actions-presubmit Step #7 - "dataproc-2.0-ubuntu18-tests": + readonly IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + readonly BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + readonly DATAPROC_IMAGE_VERSION=2.0-ubuntu18 Step #7 - "dataproc-2.0-ubuntu18-tests": + DATAPROC_IMAGE_VERSION=2.0-ubuntu18 Step #7 - "dataproc-2.0-ubuntu18-tests": + readonly POD_NAME=presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + POD_NAME=presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + gcloud container clusters get-credentials init-actions-presubmit Step #4 - "dataproc-1.5-ubuntu18-tests": + readonly IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + IMAGE=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + readonly BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + BUILD_ID=0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + readonly DATAPROC_IMAGE_VERSION=1.5-ubuntu18 Step #4 - "dataproc-1.5-ubuntu18-tests": + DATAPROC_IMAGE_VERSION=1.5-ubuntu18 Step #4 - "dataproc-1.5-ubuntu18-tests": + readonly POD_NAME=presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + POD_NAME=presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + gcloud container clusters get-credentials init-actions-presubmit Step #6 - "dataproc-2.0-rocky8-tests": Fetching cluster endpoint and auth data. Step #2 - "dataproc-1.5-debian10-tests": Fetching cluster endpoint and auth data. Step #3 - "dataproc-1.5-rocky8-tests": Fetching cluster endpoint and auth data. Step #7 - "dataproc-2.0-ubuntu18-tests": Fetching cluster endpoint and auth data. Step #5 - "dataproc-2.0-debian10-tests": Fetching cluster endpoint and auth data. Step #4 - "dataproc-1.5-ubuntu18-tests": Fetching cluster endpoint and auth data. Step #3 - "dataproc-1.5-rocky8-tests": kubeconfig entry generated for init-actions-presubmit. Step #6 - "dataproc-2.0-rocky8-tests": kubeconfig entry generated for init-actions-presubmit. Step #2 - "dataproc-1.5-debian10-tests": kubeconfig entry generated for init-actions-presubmit. Step #4 - "dataproc-1.5-ubuntu18-tests": kubeconfig entry generated for init-actions-presubmit. Step #5 - "dataproc-2.0-debian10-tests": kubeconfig entry generated for init-actions-presubmit. Step #7 - "dataproc-2.0-ubuntu18-tests": kubeconfig entry generated for init-actions-presubmit. Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T05:44:57+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl run presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --image=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 --requests=cpu=750m,memory=2Gi,ephemeral-storage=2Gi --restart=Never --env=COMMIT_SHA=cff4bac96514e99f38ae1ae05d514fe85f3277b4 --env=IMAGE_VERSION=2.0-rocky8 --command -- bash /init-actions/cloudbuild/presubmit.sh Step #3 - "dataproc-1.5-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T05:44:57+00:00 Step #3 - "dataproc-1.5-rocky8-tests": + kubectl run presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --image=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 --requests=cpu=750m,memory=2Gi,ephemeral-storage=2Gi --restart=Never --env=COMMIT_SHA=cff4bac96514e99f38ae1ae05d514fe85f3277b4 --env=IMAGE_VERSION=1.5-rocky8 --command -- bash /init-actions/cloudbuild/presubmit.sh Step #7 - "dataproc-2.0-ubuntu18-tests": ++ date --iso-8601=seconds Step #7 - "dataproc-2.0-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T05:44:57+00:00 Step #7 - "dataproc-2.0-ubuntu18-tests": + kubectl run presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --image=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 --requests=cpu=750m,memory=2Gi,ephemeral-storage=2Gi --restart=Never --env=COMMIT_SHA=cff4bac96514e99f38ae1ae05d514fe85f3277b4 --env=IMAGE_VERSION=2.0-ubuntu18 --command -- bash /init-actions/cloudbuild/presubmit.sh Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T05:44:57+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl run presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --image=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 --requests=cpu=750m,memory=2Gi,ephemeral-storage=2Gi --restart=Never --env=COMMIT_SHA=cff4bac96514e99f38ae1ae05d514fe85f3277b4 --env=IMAGE_VERSION=1.5-ubuntu18 --command -- bash /init-actions/cloudbuild/presubmit.sh Step #5 - "dataproc-2.0-debian10-tests": ++ date --iso-8601=seconds Step #5 - "dataproc-2.0-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T05:44:57+00:00 Step #5 - "dataproc-2.0-debian10-tests": + kubectl run presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --image=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 --requests=cpu=750m,memory=2Gi,ephemeral-storage=2Gi --restart=Never --env=COMMIT_SHA=cff4bac96514e99f38ae1ae05d514fe85f3277b4 --env=IMAGE_VERSION=2.0-debian10 --command -- bash /init-actions/cloudbuild/presubmit.sh Step #2 - "dataproc-1.5-debian10-tests": ++ date --iso-8601=seconds Step #2 - "dataproc-1.5-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T05:44:57+00:00 Step #2 - "dataproc-1.5-debian10-tests": + kubectl run presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --image=gcr.io/cloud-dataproc-ci/init-actions-image:0bf75426-6e63-48ba-bd59-6306458e9170 --requests=cpu=750m,memory=2Gi,ephemeral-storage=2Gi --restart=Never --env=COMMIT_SHA=cff4bac96514e99f38ae1ae05d514fe85f3277b4 --env=IMAGE_VERSION=1.5-debian10 --command -- bash /init-actions/cloudbuild/presubmit.sh Step #7 - "dataproc-2.0-ubuntu18-tests": Flag --requests has been deprecated, has no effect and will be removed in the future. Step #4 - "dataproc-1.5-ubuntu18-tests": Flag --requests has been deprecated, has no effect and will be removed in the future. Step #3 - "dataproc-1.5-rocky8-tests": Flag --requests has been deprecated, has no effect and will be removed in the future. Step #5 - "dataproc-2.0-debian10-tests": Flag --requests has been deprecated, has no effect and will be removed in the future. Step #2 - "dataproc-1.5-debian10-tests": Flag --requests has been deprecated, has no effect and will be removed in the future. Step #6 - "dataproc-2.0-rocky8-tests": Flag --requests has been deprecated, has no effect and will be removed in the future. Step #4 - "dataproc-1.5-ubuntu18-tests": Warning: Autopilot increased resource requests for Pod default/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 to meet requirements. See http://g.co/gke/autopilot-resources. Step #5 - "dataproc-2.0-debian10-tests": Warning: Autopilot increased resource requests for Pod default/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 to meet requirements. See http://g.co/gke/autopilot-resources. Step #4 - "dataproc-1.5-ubuntu18-tests": pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 created Step #3 - "dataproc-1.5-rocky8-tests": Warning: Autopilot increased resource requests for Pod default/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 to meet requirements. See http://g.co/gke/autopilot-resources. Step #4 - "dataproc-1.5-ubuntu18-tests": + trap '[[ $? != 0 ]] && kubectl describe "pod/${POD_NAME}"; kubectl delete pods "${POD_NAME}"' EXIT Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl wait --for=condition=Ready pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --timeout=15m Step #6 - "dataproc-2.0-rocky8-tests": Warning: Autopilot increased resource requests for Pod default/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 to meet requirements. See http://g.co/gke/autopilot-resources. Step #5 - "dataproc-2.0-debian10-tests": pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 created Step #3 - "dataproc-1.5-rocky8-tests": pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 created Step #5 - "dataproc-2.0-debian10-tests": + trap '[[ $? != 0 ]] && kubectl describe "pod/${POD_NAME}"; kubectl delete pods "${POD_NAME}"' EXIT Step #5 - "dataproc-2.0-debian10-tests": + kubectl wait --for=condition=Ready pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --timeout=15m Step #6 - "dataproc-2.0-rocky8-tests": pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 created Step #6 - "dataproc-2.0-rocky8-tests": + trap '[[ $? != 0 ]] && kubectl describe "pod/${POD_NAME}"; kubectl delete pods "${POD_NAME}"' EXIT Step #6 - "dataproc-2.0-rocky8-tests": + kubectl wait --for=condition=Ready pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --timeout=15m Step #3 - "dataproc-1.5-rocky8-tests": + trap '[[ $? != 0 ]] && kubectl describe "pod/${POD_NAME}"; kubectl delete pods "${POD_NAME}"' EXIT Step #3 - "dataproc-1.5-rocky8-tests": + kubectl wait --for=condition=Ready pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --timeout=15m Step #2 - "dataproc-1.5-debian10-tests": Warning: Autopilot increased resource requests for Pod default/presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 to meet requirements. See http://g.co/gke/autopilot-resources. Step #2 - "dataproc-1.5-debian10-tests": pod/presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 created Step #2 - "dataproc-1.5-debian10-tests": + trap '[[ $? != 0 ]] && kubectl describe "pod/${POD_NAME}"; kubectl delete pods "${POD_NAME}"' EXIT Step #2 - "dataproc-1.5-debian10-tests": + kubectl wait --for=condition=Ready pod/presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --timeout=15m Step #7 - "dataproc-2.0-ubuntu18-tests": Warning: Autopilot increased resource requests for Pod default/presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 to meet requirements. See http://g.co/gke/autopilot-resources. Step #7 - "dataproc-2.0-ubuntu18-tests": pod/presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 created Step #7 - "dataproc-2.0-ubuntu18-tests": + trap '[[ $? != 0 ]] && kubectl describe "pod/${POD_NAME}"; kubectl delete pods "${POD_NAME}"' EXIT Step #7 - "dataproc-2.0-ubuntu18-tests": + kubectl wait --for=condition=Ready pod/presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --timeout=15m Step #4 - "dataproc-1.5-ubuntu18-tests": pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 condition met Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:44:57+00:00 --timestamps=true Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:53.026792207Z + declare -a TESTS_TO_RUN Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:53.026870432Z + main Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:53.026880786Z + cd /init-actions Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:53.026889261Z + configure_gcloud Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:53.026897584Z + gcloud config set core/disable_prompts TRUE Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:54.595622092Z Updated property [core/disable_prompts]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:55.045681233Z + gcloud config set compute/region us-central1 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:58.190806514Z Updated property [compute/region]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:58.606623764Z + configure_gcloud_ssh_key Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:58.606719844Z + mkdir /home/ia-tests/.ssh Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:47:58.706137123Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:00.492123458Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.pub.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine.pub Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.220099730Z + chmod 600 /home/ia-tests/.ssh/google_compute_engine Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.224302373Z + initialize_git_repo Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.224358555Z + rm -fr .git Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.242235678Z + git init Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.246515243Z hint: Using 'master' as the name for the initial branch. This default branch name Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.246892179Z hint: is subject to change. To configure the initial branch name to use in all Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.247142534Z hint: of your new repositories, which will suppress this warning, call: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.247354739Z hint: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.247575698Z hint: git config --global init.defaultBranch Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.248058694Z hint: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.248241534Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.248579615Z hint: 'development'. The just-created branch can be renamed via this command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.248812242Z hint: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.248994671Z hint: git branch -m Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.249591819Z Initialized empty Git repository in /init-actions/.git/ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.250935181Z + git config user.email ia-tests@presubmit.example.com Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.255125555Z + git config user.name ia-tests Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.258511646Z + git remote add origin https://github.com/GoogleCloudDataproc/initialization-actions.git Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:02.271781134Z + git fetch origin master Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:07.347761672Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:07.347825840Z * branch master -> FETCH_HEAD Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:07.368594222Z * [new branch] master -> origin/master Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:07.392625060Z + git fetch origin '+refs/pull/*/merge:refs/remotes/origin/pr/*' Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277236034Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277295209Z * [new ref] refs/pull/10/merge -> origin/pr/10 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277309995Z * [new ref] refs/pull/1002/merge -> origin/pr/1002 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277318668Z * [new ref] refs/pull/1020/merge -> origin/pr/1020 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277327458Z * [new ref] refs/pull/1025/merge -> origin/pr/1025 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277334622Z * [new ref] refs/pull/1027/merge -> origin/pr/1027 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277342598Z * [new ref] refs/pull/1028/merge -> origin/pr/1028 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277583539Z * [new ref] refs/pull/1030/merge -> origin/pr/1030 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277602020Z * [new ref] refs/pull/1034/merge -> origin/pr/1034 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277610974Z * [new ref] refs/pull/138/merge -> origin/pr/138 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277632960Z * [new ref] refs/pull/14/merge -> origin/pr/14 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277641956Z * [new ref] refs/pull/154/merge -> origin/pr/154 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277649638Z * [new ref] refs/pull/18/merge -> origin/pr/18 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277658198Z * [new ref] refs/pull/208/merge -> origin/pr/208 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277666527Z * [new ref] refs/pull/209/merge -> origin/pr/209 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277674623Z * [new ref] refs/pull/21/merge -> origin/pr/21 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277682868Z * [new ref] refs/pull/212/merge -> origin/pr/212 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277691552Z * [new ref] refs/pull/218/merge -> origin/pr/218 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277699972Z * [new ref] refs/pull/229/merge -> origin/pr/229 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277708255Z * [new ref] refs/pull/243/merge -> origin/pr/243 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277716820Z * [new ref] refs/pull/276/merge -> origin/pr/276 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277724988Z * [new ref] refs/pull/28/merge -> origin/pr/28 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277733146Z * [new ref] refs/pull/287/merge -> origin/pr/287 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277741698Z * [new ref] refs/pull/29/merge -> origin/pr/29 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277749729Z * [new ref] refs/pull/302/merge -> origin/pr/302 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277758062Z * [new ref] refs/pull/307/merge -> origin/pr/307 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277766025Z * [new ref] refs/pull/31/merge -> origin/pr/31 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277774295Z * [new ref] refs/pull/314/merge -> origin/pr/314 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277782623Z * [new ref] refs/pull/32/merge -> origin/pr/32 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277791021Z * [new ref] refs/pull/33/merge -> origin/pr/33 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277799294Z * [new ref] refs/pull/34/merge -> origin/pr/34 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.277807369Z * [new ref] refs/pull/343/merge -> origin/pr/343 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.280593657Z * [new ref] refs/pull/355/merge -> origin/pr/355 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.280740627Z * [new ref] refs/pull/359/merge -> origin/pr/359 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.280755534Z * [new ref] refs/pull/36/merge -> origin/pr/36 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.280763643Z * [new ref] refs/pull/365/merge -> origin/pr/365 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288590576Z * [new ref] refs/pull/37/merge -> origin/pr/37 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288642701Z * [new ref] refs/pull/45/merge -> origin/pr/45 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288655863Z * [new ref] refs/pull/46/merge -> origin/pr/46 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288664857Z * [new ref] refs/pull/47/merge -> origin/pr/47 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288673326Z * [new ref] refs/pull/49/merge -> origin/pr/49 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288681502Z * [new ref] refs/pull/50/merge -> origin/pr/50 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288688504Z * [new ref] refs/pull/54/merge -> origin/pr/54 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288695853Z * [new ref] refs/pull/55/merge -> origin/pr/55 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288702948Z * [new ref] refs/pull/57/merge -> origin/pr/57 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288709733Z * [new ref] refs/pull/58/merge -> origin/pr/58 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288717214Z * [new ref] refs/pull/6/merge -> origin/pr/6 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288724817Z * [new ref] refs/pull/61/merge -> origin/pr/61 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288731638Z * [new ref] refs/pull/62/merge -> origin/pr/62 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288739400Z * [new ref] refs/pull/63/merge -> origin/pr/63 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288746793Z * [new ref] refs/pull/65/merge -> origin/pr/65 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288753786Z * [new ref] refs/pull/66/merge -> origin/pr/66 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288771154Z * [new ref] refs/pull/67/merge -> origin/pr/67 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288779038Z * [new ref] refs/pull/68/merge -> origin/pr/68 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288786701Z * [new ref] refs/pull/69/merge -> origin/pr/69 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288794447Z * [new ref] refs/pull/71/merge -> origin/pr/71 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.288802181Z * [new ref] refs/pull/752/merge -> origin/pr/752 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.290615169Z * [new ref] refs/pull/796/merge -> origin/pr/796 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.290722446Z * [new ref] refs/pull/83/merge -> origin/pr/83 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.290735083Z * [new ref] refs/pull/839/merge -> origin/pr/839 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.290742758Z * [new ref] refs/pull/842/merge -> origin/pr/842 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.292633568Z * [new ref] refs/pull/843/merge -> origin/pr/843 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.292703976Z * [new ref] refs/pull/86/merge -> origin/pr/86 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.294584481Z * [new ref] refs/pull/90/merge -> origin/pr/90 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.294671393Z * [new ref] refs/pull/920/merge -> origin/pr/920 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.295521968Z * [new ref] refs/pull/948/merge -> origin/pr/948 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.296849926Z * [new ref] refs/pull/963/merge -> origin/pr/963 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.297542075Z * [new ref] refs/pull/966/merge -> origin/pr/966 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.298955163Z * [new ref] refs/pull/967/merge -> origin/pr/967 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.299225885Z * [new ref] refs/pull/969/merge -> origin/pr/969 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.300551984Z * [new ref] refs/pull/979/merge -> origin/pr/979 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.309252363Z + git reset --hard cff4bac96514e99f38ae1ae05d514fe85f3277b4 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.695353874Z HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:08.699094732Z + git rebase origin/master Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.317328802Z Rebasing (1/23) Rebasing (2/23) Rebasing (3/23) Rebasing (4/23) Rebasing (5/23) Rebasing (6/23) Rebasing (7/23) Rebasing (8/23) Rebasing (9/23) Rebasing (10/23) Rebasing (11/23) Rebasing (12/23) Rebasing (13/23) Rebasing (14/23) Rebasing (15/23) Rebasing (16/23) Rebasing (17/23) Rebasing (18/23) Rebasing (19/23) Rebasing (20/23) Rebasing (21/23) Rebasing (22/23) Rebasing (23/23) Successfully rebased and updated refs/heads/master. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.319627966Z + determine_tests_to_run Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.320045764Z + mapfile -t DELETED_BUILD_FILES Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.322247811Z ++ git diff origin/master --name-only --diff-filter=D Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.322962992Z ++ grep BUILD Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.367520926Z + mapfile -t CHANGED_FILES Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.369216997Z ++ git diff origin/master --name-only Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.378663697Z + echo 'Deleted BUILD files: sparkRapids/BUILD' Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.378749714Z Deleted BUILD files: sparkRapids/BUILD Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379041693Z Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379082324Z + echo 'Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD' Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379242413Z + [[ 1 -gt 0 ]] Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379336402Z + echo 'All tests will be run: the following BUILD files '\''sparkRapids/BUILD'\'' were removed' Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379381502Z All tests will be run: the following BUILD files 'sparkRapids/BUILD' were removed Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379535188Z + TESTS_TO_RUN=(":DataprocInitActionsTestSuite") Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.379752039Z + return 0 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.380012520Z + run_tests Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.380196240Z + local -r max_parallel_tests=10 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.381019992Z + bazel test --jobs=10 --local_test_jobs=10 --flaky_test_attempts=3 --action_env=INTERNAL_IP_SSH=true --test_output=errors --noshow_progress --noshow_loading_progress --test_arg=--image_version=1.5-ubuntu18 :DataprocInitActionsTestSuite Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:09.638179069Z Extracting Bazel installation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:48:13.470187768Z Starting local Bazel server and connecting to it... Step #2 - "dataproc-1.5-debian10-tests": pod/presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 condition met Step #2 - "dataproc-1.5-debian10-tests": + kubectl describe pod/presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 condition met Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + kubectl logs -f presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:44:57+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:44:57+00:00 --timestamps=true Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:39.377826327Z + declare -a TESTS_TO_RUN Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:39.377875676Z + main Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:39.377883163Z + cd /init-actions Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:39.377888406Z + configure_gcloud Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:39.377896041Z + gcloud config set core/disable_prompts TRUE Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:39.393700891Z + declare -a TESTS_TO_RUN Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:39.393734871Z + main Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:39.393744199Z + cd /init-actions Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:39.393750032Z + configure_gcloud Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:39.393755076Z + gcloud config set core/disable_prompts TRUE Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:41.395860835Z Updated property [core/disable_prompts]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:41.409235879Z Updated property [core/disable_prompts]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:41.910768047Z + gcloud config set compute/region us-central1 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:41.908223859Z + gcloud config set compute/region us-central1 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:45.714396262Z Updated property [compute/region]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:45.917426385Z Updated property [compute/region]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:46.051893227Z + configure_gcloud_ssh_key Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:46.053052261Z + mkdir /home/ia-tests/.ssh Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:46.127064242Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:46.257419305Z + configure_gcloud_ssh_key Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:46.259229050Z + mkdir /home/ia-tests/.ssh Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:46.262753096Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:48.199665595Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.pub.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine.pub Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:48.361543312Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.pub.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine.pub Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.234709444Z + chmod 600 /home/ia-tests/.ssh/google_compute_engine Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.269071375Z + initialize_git_repo Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.270201914Z + rm -fr .git Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.315349915Z + git init Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322663310Z hint: Using 'master' as the name for the initial branch. This default branch name Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322702898Z hint: is subject to change. To configure the initial branch name to use in all Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322730193Z hint: of your new repositories, which will suppress this warning, call: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322740464Z hint: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322749601Z hint: git config --global init.defaultBranch Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322764127Z hint: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322772377Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322780422Z hint: 'development'. The just-created branch can be renamed via this command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322788300Z hint: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.322811796Z hint: git branch -m Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.332085105Z Initialized empty Git repository in /init-actions/.git/ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.333929537Z + git config user.email ia-tests@presubmit.example.com Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.337798634Z + git config user.name ia-tests Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.341500161Z + git remote add origin https://github.com/GoogleCloudDataproc/initialization-actions.git Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:50.346097249Z + git fetch origin master Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.364518422Z + chmod 600 /home/ia-tests/.ssh/google_compute_engine Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.365954470Z + initialize_git_repo Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.366451934Z + rm -fr .git Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.395778822Z + git init Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.400720202Z hint: Using 'master' as the name for the initial branch. This default branch name Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.400988644Z hint: is subject to change. To configure the initial branch name to use in all Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401065715Z hint: of your new repositories, which will suppress this warning, call: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401075904Z hint: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401085158Z hint: git config --global init.defaultBranch Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401092909Z hint: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401102479Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401110802Z hint: 'development'. The just-created branch can be renamed via this command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401117944Z hint: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.401125781Z hint: git branch -m Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.402260370Z Initialized empty Git repository in /init-actions/.git/ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.403849949Z + git config user.email ia-tests@presubmit.example.com Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.407024217Z + git config user.name ia-tests Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.409985399Z + git remote add origin https://github.com/GoogleCloudDataproc/initialization-actions.git Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:50.413440283Z + git fetch origin master Step #7 - "dataproc-2.0-ubuntu18-tests": pod/presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 condition met Step #7 - "dataproc-2.0-ubuntu18-tests": + kubectl describe pod/presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + grep -q Terminated Step #7 - "dataproc-2.0-ubuntu18-tests": + kubectl logs -f presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:44:57+00:00 --timestamps=true Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:52.534695604Z + declare -a TESTS_TO_RUN Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:52.535147140Z + main Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:52.535163124Z + cd /init-actions Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:52.535319096Z + configure_gcloud Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:52.535354937Z + gcloud config set core/disable_prompts TRUE Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:53.402811890Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:53.404290066Z * branch master -> FETCH_HEAD Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:53.406086035Z * [new branch] master -> origin/master Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:53.410404183Z + git fetch origin '+refs/pull/*/merge:refs/remotes/origin/pr/*' Step #5 - "dataproc-2.0-debian10-tests": pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 condition met Step #5 - "dataproc-2.0-debian10-tests": + kubectl describe pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + grep -q Terminated Step #5 - "dataproc-2.0-debian10-tests": + kubectl logs -f presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:44:57+00:00 --timestamps=true Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:53.761520204Z + declare -a TESTS_TO_RUN Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:53.761585789Z + main Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:53.761593827Z + cd /init-actions Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:53.761599539Z + configure_gcloud Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:53.761606570Z + gcloud config set core/disable_prompts TRUE Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:54.065985065Z Updated property [core/disable_prompts]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.209817033Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.210223111Z * [new ref] refs/pull/10/merge -> origin/pr/10 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.210747570Z * [new ref] refs/pull/1002/merge -> origin/pr/1002 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.211553629Z * [new ref] refs/pull/1020/merge -> origin/pr/1020 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.212250338Z * [new ref] refs/pull/1025/merge -> origin/pr/1025 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.212859553Z * [new ref] refs/pull/1027/merge -> origin/pr/1027 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.213673343Z * [new ref] refs/pull/1028/merge -> origin/pr/1028 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.215867328Z * [new ref] refs/pull/1030/merge -> origin/pr/1030 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.215886023Z * [new ref] refs/pull/1034/merge -> origin/pr/1034 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.215893950Z * [new ref] refs/pull/138/merge -> origin/pr/138 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.216250806Z * [new ref] refs/pull/14/merge -> origin/pr/14 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.217135717Z * [new ref] refs/pull/154/merge -> origin/pr/154 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.219043109Z * [new ref] refs/pull/18/merge -> origin/pr/18 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.219437571Z * [new ref] refs/pull/208/merge -> origin/pr/208 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.220181639Z * [new ref] refs/pull/209/merge -> origin/pr/209 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.221026908Z * [new ref] refs/pull/21/merge -> origin/pr/21 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.221954190Z * [new ref] refs/pull/212/merge -> origin/pr/212 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.223910630Z * [new ref] refs/pull/218/merge -> origin/pr/218 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.224159876Z * [new ref] refs/pull/229/merge -> origin/pr/229 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.224940756Z * [new ref] refs/pull/243/merge -> origin/pr/243 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.225190082Z * [new ref] refs/pull/276/merge -> origin/pr/276 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.227062406Z * [new ref] refs/pull/28/merge -> origin/pr/28 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.227289071Z * [new ref] refs/pull/287/merge -> origin/pr/287 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.227474510Z * [new ref] refs/pull/29/merge -> origin/pr/29 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.227699057Z * [new ref] refs/pull/302/merge -> origin/pr/302 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.227912420Z * [new ref] refs/pull/307/merge -> origin/pr/307 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.228174302Z * [new ref] refs/pull/31/merge -> origin/pr/31 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.228450596Z * [new ref] refs/pull/314/merge -> origin/pr/314 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.230307973Z * [new ref] refs/pull/32/merge -> origin/pr/32 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.230328961Z * [new ref] refs/pull/33/merge -> origin/pr/33 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.230645974Z * [new ref] refs/pull/34/merge -> origin/pr/34 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.231852551Z * [new ref] refs/pull/343/merge -> origin/pr/343 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.232099208Z * [new ref] refs/pull/355/merge -> origin/pr/355 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.233096776Z * [new ref] refs/pull/359/merge -> origin/pr/359 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.233343454Z * [new ref] refs/pull/36/merge -> origin/pr/36 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.233556480Z * [new ref] refs/pull/365/merge -> origin/pr/365 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.235423801Z * [new ref] refs/pull/37/merge -> origin/pr/37 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.235446985Z * [new ref] refs/pull/45/merge -> origin/pr/45 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.235510735Z * [new ref] refs/pull/46/merge -> origin/pr/46 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.236254025Z * [new ref] refs/pull/47/merge -> origin/pr/47 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.237828667Z * [new ref] refs/pull/49/merge -> origin/pr/49 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.238156438Z * [new ref] refs/pull/50/merge -> origin/pr/50 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.240143072Z * [new ref] refs/pull/54/merge -> origin/pr/54 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.240165818Z * [new ref] refs/pull/55/merge -> origin/pr/55 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.240227359Z * [new ref] refs/pull/57/merge -> origin/pr/57 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.240239098Z * [new ref] refs/pull/58/merge -> origin/pr/58 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.240255432Z * [new ref] refs/pull/6/merge -> origin/pr/6 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.241488214Z * [new ref] refs/pull/61/merge -> origin/pr/61 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.242139797Z * [new ref] refs/pull/62/merge -> origin/pr/62 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.243458944Z * [new ref] refs/pull/63/merge -> origin/pr/63 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.243481656Z * [new ref] refs/pull/65/merge -> origin/pr/65 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.243490290Z * [new ref] refs/pull/66/merge -> origin/pr/66 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.243529436Z * [new ref] refs/pull/67/merge -> origin/pr/67 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.243842552Z * [new ref] refs/pull/68/merge -> origin/pr/68 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.246986783Z * [new ref] refs/pull/69/merge -> origin/pr/69 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.247017430Z * [new ref] refs/pull/71/merge -> origin/pr/71 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.247482588Z * [new ref] refs/pull/752/merge -> origin/pr/752 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.249034333Z * [new ref] refs/pull/796/merge -> origin/pr/796 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.249057856Z * [new ref] refs/pull/83/merge -> origin/pr/83 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.249094348Z * [new ref] refs/pull/839/merge -> origin/pr/839 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.249102831Z * [new ref] refs/pull/842/merge -> origin/pr/842 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.249109841Z * [new ref] refs/pull/843/merge -> origin/pr/843 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.249119597Z * [new ref] refs/pull/86/merge -> origin/pr/86 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.250166968Z * [new ref] refs/pull/90/merge -> origin/pr/90 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.250521225Z * [new ref] refs/pull/920/merge -> origin/pr/920 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.251233090Z * [new ref] refs/pull/948/merge -> origin/pr/948 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.251785714Z * [new ref] refs/pull/963/merge -> origin/pr/963 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.254776121Z * [new ref] refs/pull/966/merge -> origin/pr/966 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.254793001Z * [new ref] refs/pull/967/merge -> origin/pr/967 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.254827657Z * [new ref] refs/pull/969/merge -> origin/pr/969 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.254836878Z * [new ref] refs/pull/979/merge -> origin/pr/979 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.263005879Z + git reset --hard cff4bac96514e99f38ae1ae05d514fe85f3277b4 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:54.606040498Z + gcloud config set compute/region us-central1 Step #3 - "dataproc-1.5-rocky8-tests": pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 condition met Step #3 - "dataproc-1.5-rocky8-tests": + kubectl describe pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + grep -q Terminated Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.717461436Z HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:54.718673388Z + git rebase origin/master Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:54.774329021Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:54.774402358Z * branch master -> FETCH_HEAD Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:54.776289322Z * [new branch] master -> origin/master Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:54.780484800Z + git fetch origin '+refs/pull/*/merge:refs/remotes/origin/pr/*' Step #3 - "dataproc-1.5-rocky8-tests": + kubectl logs -f presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:44:57+00:00 --timestamps=true Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:53.761658231Z + declare -a TESTS_TO_RUN Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:53.761676584Z + main Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:53.761680440Z + cd /init-actions Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:53.761684170Z + configure_gcloud Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:53.761687821Z + gcloud config set core/disable_prompts TRUE Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.346752199Z Rebasing (1/23) Rebasing (2/23) Rebasing (3/23) Rebasing (4/23) Rebasing (5/23) Rebasing (6/23) Rebasing (7/23) Rebasing (8/23) Rebasing (9/23) Rebasing (10/23) Rebasing (11/23) Rebasing (12/23) Rebasing (13/23) Rebasing (14/23) Rebasing (15/23) Rebasing (16/23) Rebasing (17/23) Rebasing (18/23) Rebasing (19/23) Rebasing (20/23) Rebasing (21/23) Rebasing (22/23) Rebasing (23/23) Successfully rebased and updated refs/heads/master. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.348273312Z + determine_tests_to_run Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.348342832Z + mapfile -t DELETED_BUILD_FILES Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.349921236Z ++ git diff origin/master --name-only --diff-filter=D Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.355787049Z ++ grep BUILD Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.391430518Z + mapfile -t CHANGED_FILES Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.392549501Z ++ git diff origin/master --name-only Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.400885491Z Deleted BUILD files: sparkRapids/BUILD Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.400984411Z Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401003991Z All tests will be run: the following BUILD files 'sparkRapids/BUILD' were removed Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.400952700Z + echo 'Deleted BUILD files: sparkRapids/BUILD' Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401045448Z + echo 'Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD' Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401053696Z + [[ 1 -gt 0 ]] Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401060596Z + echo 'All tests will be run: the following BUILD files '\''sparkRapids/BUILD'\'' were removed' Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401081237Z + TESTS_TO_RUN=(":DataprocInitActionsTestSuite") Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401091115Z + return 0 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401116860Z + run_tests Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.401955406Z + local -r max_parallel_tests=10 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.403356182Z + bazel test --jobs=10 --local_test_jobs=10 --flaky_test_attempts=3 --action_env=INTERNAL_IP_SSH=true --test_output=errors --noshow_progress --noshow_loading_progress --test_arg=--image_version=1.5-debian10 :DataprocInitActionsTestSuite Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.586322905Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.586395943Z * [new ref] refs/pull/10/merge -> origin/pr/10 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.586935999Z * [new ref] refs/pull/1002/merge -> origin/pr/1002 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.588114936Z * [new ref] refs/pull/1020/merge -> origin/pr/1020 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.589107430Z * [new ref] refs/pull/1025/merge -> origin/pr/1025 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.590113355Z * [new ref] refs/pull/1027/merge -> origin/pr/1027 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.590569445Z * [new ref] refs/pull/1028/merge -> origin/pr/1028 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.591792916Z * [new ref] refs/pull/1030/merge -> origin/pr/1030 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.592660831Z * [new ref] refs/pull/1034/merge -> origin/pr/1034 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.593460537Z * [new ref] refs/pull/138/merge -> origin/pr/138 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.594140617Z * [new ref] refs/pull/14/merge -> origin/pr/14 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.594961850Z * [new ref] refs/pull/154/merge -> origin/pr/154 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.595507284Z * [new ref] refs/pull/18/merge -> origin/pr/18 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.595685725Z * [new ref] refs/pull/208/merge -> origin/pr/208 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.596004763Z * [new ref] refs/pull/209/merge -> origin/pr/209 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.596293772Z * [new ref] refs/pull/21/merge -> origin/pr/21 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.596680758Z * [new ref] refs/pull/212/merge -> origin/pr/212 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.597350606Z * [new ref] refs/pull/218/merge -> origin/pr/218 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.597370699Z * [new ref] refs/pull/229/merge -> origin/pr/229 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.597900867Z * [new ref] refs/pull/243/merge -> origin/pr/243 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.598105219Z * [new ref] refs/pull/276/merge -> origin/pr/276 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.598178671Z * [new ref] refs/pull/28/merge -> origin/pr/28 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.598804567Z * [new ref] refs/pull/287/merge -> origin/pr/287 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.598988672Z * [new ref] refs/pull/29/merge -> origin/pr/29 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.599204923Z * [new ref] refs/pull/302/merge -> origin/pr/302 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.599790724Z * [new ref] refs/pull/307/merge -> origin/pr/307 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.599811967Z * [new ref] refs/pull/31/merge -> origin/pr/31 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.600234329Z * [new ref] refs/pull/314/merge -> origin/pr/314 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.601097674Z * [new ref] refs/pull/32/merge -> origin/pr/32 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.601118290Z * [new ref] refs/pull/33/merge -> origin/pr/33 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.601126835Z * [new ref] refs/pull/34/merge -> origin/pr/34 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.603179853Z * [new ref] refs/pull/343/merge -> origin/pr/343 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.603201277Z * [new ref] refs/pull/355/merge -> origin/pr/355 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.603209402Z * [new ref] refs/pull/359/merge -> origin/pr/359 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.603216521Z * [new ref] refs/pull/36/merge -> origin/pr/36 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.603233547Z * [new ref] refs/pull/365/merge -> origin/pr/365 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.603241681Z * [new ref] refs/pull/37/merge -> origin/pr/37 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.604378337Z * [new ref] refs/pull/45/merge -> origin/pr/45 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.604397934Z * [new ref] refs/pull/46/merge -> origin/pr/46 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.604406139Z * [new ref] refs/pull/47/merge -> origin/pr/47 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.605636697Z * [new ref] refs/pull/49/merge -> origin/pr/49 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.605675925Z * [new ref] refs/pull/50/merge -> origin/pr/50 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.605685524Z * [new ref] refs/pull/54/merge -> origin/pr/54 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.605714478Z * [new ref] refs/pull/55/merge -> origin/pr/55 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.606451438Z * [new ref] refs/pull/57/merge -> origin/pr/57 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.606493895Z * [new ref] refs/pull/58/merge -> origin/pr/58 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.606896373Z * [new ref] refs/pull/6/merge -> origin/pr/6 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.607234247Z * [new ref] refs/pull/61/merge -> origin/pr/61 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.607831555Z * [new ref] refs/pull/62/merge -> origin/pr/62 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.607854318Z * [new ref] refs/pull/63/merge -> origin/pr/63 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.608313309Z * [new ref] refs/pull/65/merge -> origin/pr/65 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.608374905Z * [new ref] refs/pull/66/merge -> origin/pr/66 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.609571680Z * [new ref] refs/pull/67/merge -> origin/pr/67 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.609797195Z * [new ref] refs/pull/68/merge -> origin/pr/68 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.609816935Z * [new ref] refs/pull/69/merge -> origin/pr/69 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.609834328Z * [new ref] refs/pull/71/merge -> origin/pr/71 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615935200Z * [new ref] refs/pull/752/merge -> origin/pr/752 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615959862Z * [new ref] refs/pull/796/merge -> origin/pr/796 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615970473Z * [new ref] refs/pull/83/merge -> origin/pr/83 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615978317Z * [new ref] refs/pull/839/merge -> origin/pr/839 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615985332Z * [new ref] refs/pull/842/merge -> origin/pr/842 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:48:55.617725469Z Extracting Bazel installation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615992122Z * [new ref] refs/pull/843/merge -> origin/pr/843 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.615998897Z * [new ref] refs/pull/86/merge -> origin/pr/86 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616005566Z * [new ref] refs/pull/90/merge -> origin/pr/90 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616012938Z * [new ref] refs/pull/920/merge -> origin/pr/920 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616019677Z * [new ref] refs/pull/948/merge -> origin/pr/948 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616029407Z * [new ref] refs/pull/963/merge -> origin/pr/963 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616037340Z * [new ref] refs/pull/966/merge -> origin/pr/966 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616044335Z * [new ref] refs/pull/967/merge -> origin/pr/967 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616051542Z * [new ref] refs/pull/969/merge -> origin/pr/969 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.616058626Z * [new ref] refs/pull/979/merge -> origin/pr/979 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:55.622776656Z + git reset --hard cff4bac96514e99f38ae1ae05d514fe85f3277b4 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:56.034047362Z Updated property [core/disable_prompts]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:56.073291010Z Updated property [core/disable_prompts]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:56.133655249Z HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:48:56.136024662Z + git rebase origin/master Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:48:56.569279183Z + gcloud config set compute/region us-central1 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:48:56.643836335Z + gcloud config set compute/region us-central1 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:57.542277332Z Updated property [compute/region]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:58.068620986Z + configure_gcloud_ssh_key Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:58.068769188Z + mkdir /home/ia-tests/.ssh Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:58.138773486Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:48:59.707581835Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.pub.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine.pub Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:00.885249236Z Updated property [compute/region]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:01.042991522Z Updated property [compute/region]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.338638560Z + chmod 600 /home/ia-tests/.ssh/google_compute_engine Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.381446474Z + initialize_git_repo Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.381520618Z + rm -fr .git Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.389601852Z + git init Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.393930183Z hint: Using 'master' as the name for the initial branch. This default branch name Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.393972646Z hint: is subject to change. To configure the initial branch name to use in all Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.393983633Z hint: of your new repositories, which will suppress this warning, call: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394011232Z hint: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394021287Z hint: git config --global init.defaultBranch Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394030227Z hint: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394048249Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394057265Z hint: 'development'. The just-created branch can be renamed via this command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394066553Z hint: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.394075131Z hint: git branch -m Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:49:01.393040790Z INFO: Analyzed 32 targets (82 packages loaded, 718 targets configured). Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.398548317Z Initialized empty Git repository in /init-actions/.git/ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.399220634Z + git config user.email ia-tests@presubmit.example.com Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.402335385Z + git config user.name ia-tests Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.405114879Z + git remote add origin https://github.com/GoogleCloudDataproc/initialization-actions.git Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:01.408886452Z + git fetch origin master Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:49:01.412943385Z INFO: Found 32 test targets... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:01.532321557Z + configure_gcloud_ssh_key Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:01.532607554Z + mkdir /home/ia-tests/.ssh Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:01.590009538Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:01.735335831Z + configure_gcloud_ssh_key Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:01.735477667Z + mkdir /home/ia-tests/.ssh Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.738012764Z Rebasing (1/23) Rebasing (2/23) Rebasing (3/23) Rebasing (4/23) Rebasing (5/23) Rebasing (6/23) Rebasing (7/23) Rebasing (8/23) Rebasing (9/23) Rebasing (10/23) Rebasing (11/23) Rebasing (12/23) Rebasing (13/23) Rebasing (14/23) Rebasing (15/23) Rebasing (16/23) Rebasing (17/23) Rebasing (18/23) Rebasing (19/23) Rebasing (20/23) Rebasing (21/23) Rebasing (22/23) Rebasing (23/23) Successfully rebased and updated refs/heads/master. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.739977313Z + determine_tests_to_run Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:01.739291389Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.740049842Z + mapfile -t DELETED_BUILD_FILES Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.741804068Z ++ git diff origin/master --name-only --diff-filter=D Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.741912650Z ++ grep BUILD Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.810665208Z + mapfile -t CHANGED_FILES Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.810709816Z ++ git diff origin/master --name-only Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.816972103Z + echo 'Deleted BUILD files: sparkRapids/BUILD' Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.817070045Z Deleted BUILD files: sparkRapids/BUILD Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.817093357Z + echo 'Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD' Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.817526824Z Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.818043832Z + [[ 1 -gt 0 ]] Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.818076172Z + echo 'All tests will be run: the following BUILD files '\''sparkRapids/BUILD'\'' were removed' Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.818384425Z All tests will be run: the following BUILD files 'sparkRapids/BUILD' were removed Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.818428838Z + TESTS_TO_RUN=(":DataprocInitActionsTestSuite") Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.818816877Z + return 0 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.819227390Z + run_tests Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.819307969Z + local -r max_parallel_tests=10 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:01.819657621Z + bazel test --jobs=10 --local_test_jobs=10 --flaky_test_attempts=3 --action_env=INTERNAL_IP_SSH=true --test_output=errors --noshow_progress --noshow_loading_progress --test_arg=--image_version=2.0-rocky8 :DataprocInitActionsTestSuite Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:02.197242005Z Extracting Bazel installation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:04.191735829Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.pub.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine.pub Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:04.401987992Z + gcloud kms decrypt --location=global --keyring=presubmit --key=presubmit --ciphertext-file=cloudbuild/ssh-key.pub.enc --plaintext-file=/home/ia-tests/.ssh/google_compute_engine.pub Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:04.854970106Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:04.857124365Z * branch master -> FETCH_HEAD Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:04.858132995Z * [new branch] master -> origin/master Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:04.860439244Z + git fetch origin '+refs/pull/*/merge:refs/remotes/origin/pr/*' Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.606510252Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.606585282Z * [new ref] refs/pull/10/merge -> origin/pr/10 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.607400921Z * [new ref] refs/pull/1002/merge -> origin/pr/1002 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.607551168Z * [new ref] refs/pull/1020/merge -> origin/pr/1020 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.608132359Z * [new ref] refs/pull/1025/merge -> origin/pr/1025 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.609526961Z * [new ref] refs/pull/1027/merge -> origin/pr/1027 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.609577358Z * [new ref] refs/pull/1028/merge -> origin/pr/1028 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.610133198Z * [new ref] refs/pull/1030/merge -> origin/pr/1030 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.610192760Z * [new ref] refs/pull/1034/merge -> origin/pr/1034 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.611599108Z * [new ref] refs/pull/138/merge -> origin/pr/138 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.611677482Z * [new ref] refs/pull/14/merge -> origin/pr/14 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.611691072Z * [new ref] refs/pull/154/merge -> origin/pr/154 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.612079559Z * [new ref] refs/pull/18/merge -> origin/pr/18 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.612332160Z * [new ref] refs/pull/208/merge -> origin/pr/208 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.613552059Z * [new ref] refs/pull/209/merge -> origin/pr/209 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.613578446Z * [new ref] refs/pull/21/merge -> origin/pr/21 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.613918305Z * [new ref] refs/pull/212/merge -> origin/pr/212 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.614442498Z * [new ref] refs/pull/218/merge -> origin/pr/218 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.615607903Z * [new ref] refs/pull/229/merge -> origin/pr/229 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.615656327Z * [new ref] refs/pull/243/merge -> origin/pr/243 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.616016659Z * [new ref] refs/pull/276/merge -> origin/pr/276 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.616106019Z * [new ref] refs/pull/28/merge -> origin/pr/28 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.617227164Z * [new ref] refs/pull/287/merge -> origin/pr/287 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.617537746Z * [new ref] refs/pull/29/merge -> origin/pr/29 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.617570883Z * [new ref] refs/pull/302/merge -> origin/pr/302 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.618313441Z * [new ref] refs/pull/307/merge -> origin/pr/307 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.618932560Z * [new ref] refs/pull/31/merge -> origin/pr/31 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.619170437Z * [new ref] refs/pull/314/merge -> origin/pr/314 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.619377744Z * [new ref] refs/pull/32/merge -> origin/pr/32 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.619589797Z * [new ref] refs/pull/33/merge -> origin/pr/33 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.620119645Z * [new ref] refs/pull/34/merge -> origin/pr/34 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.620764715Z * [new ref] refs/pull/343/merge -> origin/pr/343 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.620982661Z * [new ref] refs/pull/355/merge -> origin/pr/355 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.621498815Z * [new ref] refs/pull/359/merge -> origin/pr/359 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.622044572Z * [new ref] refs/pull/36/merge -> origin/pr/36 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.622287175Z * [new ref] refs/pull/365/merge -> origin/pr/365 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.622495328Z * [new ref] refs/pull/37/merge -> origin/pr/37 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.622904236Z * [new ref] refs/pull/45/merge -> origin/pr/45 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.623171366Z * [new ref] refs/pull/46/merge -> origin/pr/46 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.623592339Z * [new ref] refs/pull/47/merge -> origin/pr/47 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.624015532Z * [new ref] refs/pull/49/merge -> origin/pr/49 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.624842407Z * [new ref] refs/pull/50/merge -> origin/pr/50 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.625075327Z * [new ref] refs/pull/54/merge -> origin/pr/54 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.625312382Z * [new ref] refs/pull/55/merge -> origin/pr/55 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.625911204Z * [new ref] refs/pull/57/merge -> origin/pr/57 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.626529126Z * [new ref] refs/pull/58/merge -> origin/pr/58 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.626782935Z * [new ref] refs/pull/6/merge -> origin/pr/6 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.626994855Z * [new ref] refs/pull/61/merge -> origin/pr/61 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.638501721Z * [new ref] refs/pull/62/merge -> origin/pr/62 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.639457423Z * [new ref] refs/pull/63/merge -> origin/pr/63 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.639812908Z * [new ref] refs/pull/65/merge -> origin/pr/65 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.640087786Z * [new ref] refs/pull/66/merge -> origin/pr/66 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.640501038Z * [new ref] refs/pull/67/merge -> origin/pr/67 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.640728606Z * [new ref] refs/pull/68/merge -> origin/pr/68 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.640933019Z * [new ref] refs/pull/69/merge -> origin/pr/69 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.641160576Z * [new ref] refs/pull/71/merge -> origin/pr/71 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.641441228Z * [new ref] refs/pull/752/merge -> origin/pr/752 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.641650731Z * [new ref] refs/pull/796/merge -> origin/pr/796 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.641849152Z * [new ref] refs/pull/83/merge -> origin/pr/83 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.642098625Z * [new ref] refs/pull/839/merge -> origin/pr/839 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.642362765Z * [new ref] refs/pull/842/merge -> origin/pr/842 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.642585907Z * [new ref] refs/pull/843/merge -> origin/pr/843 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.642820581Z * [new ref] refs/pull/86/merge -> origin/pr/86 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.643071809Z * [new ref] refs/pull/90/merge -> origin/pr/90 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.644800553Z * [new ref] refs/pull/920/merge -> origin/pr/920 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.645082390Z * [new ref] refs/pull/948/merge -> origin/pr/948 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.645328556Z * [new ref] refs/pull/963/merge -> origin/pr/963 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.645527168Z * [new ref] refs/pull/966/merge -> origin/pr/966 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.645749948Z * [new ref] refs/pull/967/merge -> origin/pr/967 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.645937713Z * [new ref] refs/pull/969/merge -> origin/pr/969 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.646120340Z * [new ref] refs/pull/979/merge -> origin/pr/979 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:05.652493657Z + git reset --hard cff4bac96514e99f38ae1ae05d514fe85f3277b4 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:49:05.957617389Z Starting local Bazel server and connecting to it... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:06.050121514Z HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:06.052605312Z + git rebase origin/master Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:06.192845069Z Starting local Bazel server and connecting to it... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.639265364Z + chmod 600 /home/ia-tests/.ssh/google_compute_engine Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.644621792Z + initialize_git_repo Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.645467888Z + rm -fr .git Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.673270275Z + git init Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.679466777Z hint: Using 'master' as the name for the initial branch. This default branch name Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680089828Z hint: is subject to change. To configure the initial branch name to use in all Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680141096Z hint: of your new repositories, which will suppress this warning, call: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680171230Z hint: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680180158Z hint: git config --global init.defaultBranch Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680187258Z hint: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680194718Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680202018Z hint: 'development'. The just-created branch can be renamed via this command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680208791Z hint: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.680216605Z hint: git branch -m Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.711677752Z Initialized empty Git repository in /init-actions/.git/ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.712384499Z + git config user.email ia-tests@presubmit.example.com Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.716775069Z + git config user.name ia-tests Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.720109644Z + git remote add origin https://github.com/GoogleCloudDataproc/initialization-actions.git Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:06.724663292Z + git fetch origin master Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.933107221Z + chmod 600 /home/ia-tests/.ssh/google_compute_engine Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.935631816Z + initialize_git_repo Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.936029526Z + rm -fr .git Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.941568523Z + git init Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969330000Z hint: Using 'master' as the name for the initial branch. This default branch name Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969379857Z hint: is subject to change. To configure the initial branch name to use in all Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969390618Z hint: of your new repositories, which will suppress this warning, call: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969399823Z hint: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969409567Z hint: git config --global init.defaultBranch Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969417900Z hint: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969425851Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969434121Z hint: 'development'. The just-created branch can be renamed via this command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969441422Z hint: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.969450673Z hint: git branch -m Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.971658240Z Initialized empty Git repository in /init-actions/.git/ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.972141914Z + git config user.email ia-tests@presubmit.example.com Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.975516895Z + git config user.name ia-tests Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.978097437Z + git remote add origin https://github.com/GoogleCloudDataproc/initialization-actions.git Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:06.982451522Z + git fetch origin master Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.174947655Z Rebasing (1/23) Rebasing (2/23) Rebasing (3/23) Rebasing (4/23) Rebasing (5/23) Rebasing (6/23) Rebasing (7/23) Rebasing (8/23) Rebasing (9/23) Rebasing (10/23) Rebasing (11/23) Rebasing (12/23) Rebasing (13/23) Rebasing (14/23) Rebasing (15/23) Rebasing (16/23) Rebasing (17/23) Rebasing (18/23) Rebasing (19/23) Rebasing (20/23) Rebasing (21/23) Rebasing (22/23) Rebasing (23/23) Successfully rebased and updated refs/heads/master. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.177500912Z + determine_tests_to_run Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.177567464Z + mapfile -t DELETED_BUILD_FILES Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.179320596Z ++ grep BUILD Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.180648101Z ++ git diff origin/master --name-only --diff-filter=D Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.248164599Z + mapfile -t CHANGED_FILES Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.249192176Z ++ git diff origin/master --name-only Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.258298192Z + echo 'Deleted BUILD files: sparkRapids/BUILD' Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259013167Z + echo 'Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD' Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259102932Z + [[ 1 -gt 0 ]] Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259116613Z + echo 'All tests will be run: the following BUILD files '\''sparkRapids/BUILD'\'' were removed' Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259126142Z + TESTS_TO_RUN=(":DataprocInitActionsTestSuite") Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259135129Z + return 0 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259143553Z + run_tests Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259152581Z + local -r max_parallel_tests=10 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259177547Z + bazel test --jobs=10 --local_test_jobs=10 --flaky_test_attempts=3 --action_env=INTERNAL_IP_SSH=true --test_output=errors --noshow_progress --noshow_loading_progress --test_arg=--image_version=2.0-ubuntu18 :DataprocInitActionsTestSuite Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.258995782Z Deleted BUILD files: sparkRapids/BUILD Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259239498Z Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.259249890Z All tests will be run: the following BUILD files 'sparkRapids/BUILD' were removed Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:07.552935146Z Extracting Bazel installation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:10.448577915Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:10.449772517Z * branch master -> FETCH_HEAD Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:10.450038254Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:10.450119883Z * branch master -> FETCH_HEAD Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:10.453059664Z * [new branch] master -> origin/master Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:10.461062858Z * [new branch] master -> origin/master Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:10.460996248Z + git fetch origin '+refs/pull/*/merge:refs/remotes/origin/pr/*' Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:10.464216871Z + git fetch origin '+refs/pull/*/merge:refs/remotes/origin/pr/*' Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.276521653Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.276591950Z * [new ref] refs/pull/10/merge -> origin/pr/10 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.276719348Z * [new ref] refs/pull/1002/merge -> origin/pr/1002 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.277122462Z * [new ref] refs/pull/1020/merge -> origin/pr/1020 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.277461538Z * [new ref] refs/pull/1025/merge -> origin/pr/1025 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.277873339Z * [new ref] refs/pull/1027/merge -> origin/pr/1027 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.278357637Z * [new ref] refs/pull/1028/merge -> origin/pr/1028 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.278631528Z * [new ref] refs/pull/1030/merge -> origin/pr/1030 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.278978856Z * [new ref] refs/pull/1034/merge -> origin/pr/1034 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.279346575Z * [new ref] refs/pull/138/merge -> origin/pr/138 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.279730522Z * [new ref] refs/pull/14/merge -> origin/pr/14 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.280448881Z * [new ref] refs/pull/154/merge -> origin/pr/154 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.280708127Z * [new ref] refs/pull/18/merge -> origin/pr/18 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.280938053Z * [new ref] refs/pull/208/merge -> origin/pr/208 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289030161Z * [new ref] refs/pull/209/merge -> origin/pr/209 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289133999Z * [new ref] refs/pull/21/merge -> origin/pr/21 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289158710Z * [new ref] refs/pull/212/merge -> origin/pr/212 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289199185Z * [new ref] refs/pull/218/merge -> origin/pr/218 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289209908Z * [new ref] refs/pull/229/merge -> origin/pr/229 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289218056Z * [new ref] refs/pull/243/merge -> origin/pr/243 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289225781Z * [new ref] refs/pull/276/merge -> origin/pr/276 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289233430Z * [new ref] refs/pull/28/merge -> origin/pr/28 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289241201Z * [new ref] refs/pull/287/merge -> origin/pr/287 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289249678Z * [new ref] refs/pull/29/merge -> origin/pr/29 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289257372Z * [new ref] refs/pull/302/merge -> origin/pr/302 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289284798Z * [new ref] refs/pull/307/merge -> origin/pr/307 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289294235Z * [new ref] refs/pull/31/merge -> origin/pr/31 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289303181Z * [new ref] refs/pull/314/merge -> origin/pr/314 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289311285Z * [new ref] refs/pull/32/merge -> origin/pr/32 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289319376Z * [new ref] refs/pull/33/merge -> origin/pr/33 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289327148Z * [new ref] refs/pull/34/merge -> origin/pr/34 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289334988Z * [new ref] refs/pull/343/merge -> origin/pr/343 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289342675Z * [new ref] refs/pull/355/merge -> origin/pr/355 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289368704Z * [new ref] refs/pull/359/merge -> origin/pr/359 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289379062Z * [new ref] refs/pull/36/merge -> origin/pr/36 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289387160Z * [new ref] refs/pull/365/merge -> origin/pr/365 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289395103Z * [new ref] refs/pull/37/merge -> origin/pr/37 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289418287Z * [new ref] refs/pull/45/merge -> origin/pr/45 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.289474894Z * [new ref] refs/pull/46/merge -> origin/pr/46 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.292135844Z * [new ref] refs/pull/47/merge -> origin/pr/47 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.293484967Z * [new ref] refs/pull/49/merge -> origin/pr/49 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.295053013Z * [new ref] refs/pull/50/merge -> origin/pr/50 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.295115849Z * [new ref] refs/pull/54/merge -> origin/pr/54 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.296165141Z * [new ref] refs/pull/55/merge -> origin/pr/55 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.295963608Z From https://github.com/GoogleCloudDataproc/initialization-actions Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.296206182Z * [new ref] refs/pull/10/merge -> origin/pr/10 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.297547666Z * [new ref] refs/pull/57/merge -> origin/pr/57 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.298376536Z * [new ref] refs/pull/58/merge -> origin/pr/58 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.299228161Z * [new ref] refs/pull/6/merge -> origin/pr/6 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.302125444Z * [new ref] refs/pull/1002/merge -> origin/pr/1002 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.302522834Z * [new ref] refs/pull/61/merge -> origin/pr/61 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.302667741Z * [new ref] refs/pull/62/merge -> origin/pr/62 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.302683500Z * [new ref] refs/pull/63/merge -> origin/pr/63 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.302692897Z * [new ref] refs/pull/65/merge -> origin/pr/65 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.302372313Z * [new ref] refs/pull/1020/merge -> origin/pr/1020 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.302476800Z * [new ref] refs/pull/1025/merge -> origin/pr/1025 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.302491431Z * [new ref] refs/pull/1027/merge -> origin/pr/1027 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.302500044Z * [new ref] refs/pull/1028/merge -> origin/pr/1028 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308866713Z * [new ref] refs/pull/1030/merge -> origin/pr/1030 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308879417Z * [new ref] refs/pull/1034/merge -> origin/pr/1034 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308888022Z * [new ref] refs/pull/138/merge -> origin/pr/138 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308954699Z * [new ref] refs/pull/14/merge -> origin/pr/14 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308965499Z * [new ref] refs/pull/154/merge -> origin/pr/154 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308974270Z * [new ref] refs/pull/18/merge -> origin/pr/18 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308982066Z * [new ref] refs/pull/208/merge -> origin/pr/208 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308989855Z * [new ref] refs/pull/209/merge -> origin/pr/209 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.308997692Z * [new ref] refs/pull/21/merge -> origin/pr/21 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.309005347Z * [new ref] refs/pull/212/merge -> origin/pr/212 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.309012928Z * [new ref] refs/pull/218/merge -> origin/pr/218 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.309020811Z * [new ref] refs/pull/229/merge -> origin/pr/229 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.309028411Z * [new ref] refs/pull/243/merge -> origin/pr/243 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.309036603Z * [new ref] refs/pull/276/merge -> origin/pr/276 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.309045224Z * [new ref] refs/pull/28/merge -> origin/pr/28 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308724976Z * [new ref] refs/pull/66/merge -> origin/pr/66 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308766085Z * [new ref] refs/pull/67/merge -> origin/pr/67 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308775946Z * [new ref] refs/pull/68/merge -> origin/pr/68 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308783804Z * [new ref] refs/pull/69/merge -> origin/pr/69 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308791007Z * [new ref] refs/pull/71/merge -> origin/pr/71 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308798752Z * [new ref] refs/pull/752/merge -> origin/pr/752 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308806361Z * [new ref] refs/pull/796/merge -> origin/pr/796 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308814488Z * [new ref] refs/pull/83/merge -> origin/pr/83 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308823564Z * [new ref] refs/pull/839/merge -> origin/pr/839 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308832148Z * [new ref] refs/pull/842/merge -> origin/pr/842 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.308840927Z * [new ref] refs/pull/843/merge -> origin/pr/843 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313081984Z * [new ref] refs/pull/86/merge -> origin/pr/86 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313141150Z * [new ref] refs/pull/90/merge -> origin/pr/90 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313153446Z * [new ref] refs/pull/920/merge -> origin/pr/920 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313163150Z * [new ref] refs/pull/948/merge -> origin/pr/948 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313171477Z * [new ref] refs/pull/963/merge -> origin/pr/963 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313179727Z * [new ref] refs/pull/966/merge -> origin/pr/966 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313188587Z * [new ref] refs/pull/967/merge -> origin/pr/967 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313197076Z * [new ref] refs/pull/969/merge -> origin/pr/969 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.313205309Z * [new ref] refs/pull/979/merge -> origin/pr/979 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.313231229Z * [new ref] refs/pull/287/merge -> origin/pr/287 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.313244182Z * [new ref] refs/pull/29/merge -> origin/pr/29 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.313253294Z * [new ref] refs/pull/302/merge -> origin/pr/302 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.313261953Z * [new ref] refs/pull/307/merge -> origin/pr/307 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.313269860Z * [new ref] refs/pull/31/merge -> origin/pr/31 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.313278389Z * [new ref] refs/pull/314/merge -> origin/pr/314 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.316098951Z * [new ref] refs/pull/32/merge -> origin/pr/32 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.316131114Z * [new ref] refs/pull/33/merge -> origin/pr/33 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321011041Z * [new ref] refs/pull/34/merge -> origin/pr/34 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321046094Z * [new ref] refs/pull/343/merge -> origin/pr/343 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321055381Z * [new ref] refs/pull/355/merge -> origin/pr/355 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321074744Z * [new ref] refs/pull/359/merge -> origin/pr/359 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321083005Z * [new ref] refs/pull/36/merge -> origin/pr/36 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321090812Z * [new ref] refs/pull/365/merge -> origin/pr/365 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321098716Z * [new ref] refs/pull/37/merge -> origin/pr/37 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321106865Z * [new ref] refs/pull/45/merge -> origin/pr/45 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321114993Z * [new ref] refs/pull/46/merge -> origin/pr/46 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321122713Z * [new ref] refs/pull/47/merge -> origin/pr/47 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321130303Z * [new ref] refs/pull/49/merge -> origin/pr/49 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.321137937Z * [new ref] refs/pull/50/merge -> origin/pr/50 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.324006435Z + git reset --hard cff4bac96514e99f38ae1ae05d514fe85f3277b4 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.323050656Z * [new ref] refs/pull/54/merge -> origin/pr/54 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.324126097Z * [new ref] refs/pull/55/merge -> origin/pr/55 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.326640760Z * [new ref] refs/pull/57/merge -> origin/pr/57 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.326714853Z * [new ref] refs/pull/58/merge -> origin/pr/58 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333263291Z * [new ref] refs/pull/6/merge -> origin/pr/6 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333398281Z * [new ref] refs/pull/61/merge -> origin/pr/61 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333698910Z * [new ref] refs/pull/62/merge -> origin/pr/62 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333717186Z * [new ref] refs/pull/63/merge -> origin/pr/63 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333725968Z * [new ref] refs/pull/65/merge -> origin/pr/65 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333733904Z * [new ref] refs/pull/66/merge -> origin/pr/66 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333780936Z * [new ref] refs/pull/67/merge -> origin/pr/67 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333789607Z * [new ref] refs/pull/68/merge -> origin/pr/68 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333796918Z * [new ref] refs/pull/69/merge -> origin/pr/69 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333804206Z * [new ref] refs/pull/71/merge -> origin/pr/71 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333811545Z * [new ref] refs/pull/752/merge -> origin/pr/752 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333818662Z * [new ref] refs/pull/796/merge -> origin/pr/796 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333825859Z * [new ref] refs/pull/83/merge -> origin/pr/83 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333833447Z * [new ref] refs/pull/839/merge -> origin/pr/839 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333840915Z * [new ref] refs/pull/842/merge -> origin/pr/842 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.333859508Z * [new ref] refs/pull/843/merge -> origin/pr/843 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.336000168Z * [new ref] refs/pull/86/merge -> origin/pr/86 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.337354485Z * [new ref] refs/pull/90/merge -> origin/pr/90 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.340042930Z * [new ref] refs/pull/920/merge -> origin/pr/920 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.340102907Z * [new ref] refs/pull/948/merge -> origin/pr/948 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.340114967Z * [new ref] refs/pull/963/merge -> origin/pr/963 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.340567480Z * [new ref] refs/pull/966/merge -> origin/pr/966 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.341748152Z * [new ref] refs/pull/967/merge -> origin/pr/967 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.348008202Z * [new ref] refs/pull/969/merge -> origin/pr/969 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.348070833Z * [new ref] refs/pull/979/merge -> origin/pr/979 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.353329700Z + git reset --hard cff4bac96514e99f38ae1ae05d514fe85f3277b4 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.871987904Z HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:11.874567193Z + git rebase origin/master Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.895089230Z HEAD is now at cff4bac update the driver version to latest because there are issues with 495 driver Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:11.897400905Z + git rebase origin/master Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.507022582Z Rebasing (1/23) Rebasing (2/23) Rebasing (3/23) Rebasing (4/23) Rebasing (5/23) Rebasing (6/23) Rebasing (7/23) Rebasing (8/23) Rebasing (9/23) Rebasing (10/23) Rebasing (11/23) Rebasing (12/23) Rebasing (13/23) Rebasing (14/23) Rebasing (15/23) Rebasing (16/23) Rebasing (17/23) Rebasing (18/23) Rebasing (19/23) Rebasing (20/23) Rebasing (21/23) Rebasing (22/23) Rebasing (23/23) Successfully rebased and updated refs/heads/master. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.514116795Z + determine_tests_to_run Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.514591897Z + mapfile -t DELETED_BUILD_FILES Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.518271193Z ++ git diff origin/master --name-only --diff-filter=D Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.519959461Z ++ grep BUILD Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.535064517Z Rebasing (1/23) Rebasing (2/23) Rebasing (3/23) Rebasing (4/23) Rebasing (5/23) Rebasing (6/23) Rebasing (7/23) Rebasing (8/23) Rebasing (9/23) Rebasing (10/23) Rebasing (11/23) Rebasing (12/23) Rebasing (13/23) Rebasing (14/23) Rebasing (15/23) Rebasing (16/23) Rebasing (17/23) Rebasing (18/23) Rebasing (19/23) Rebasing (20/23) Rebasing (21/23) Rebasing (22/23) Rebasing (23/23) Successfully rebased and updated refs/heads/master. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.535154529Z + determine_tests_to_run Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.535164656Z + mapfile -t DELETED_BUILD_FILES Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.535173060Z ++ git diff origin/master --name-only --diff-filter=D Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.535181760Z ++ grep BUILD Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.629237799Z + mapfile -t CHANGED_FILES Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.631129037Z + mapfile -t CHANGED_FILES Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.632681525Z ++ git diff origin/master --name-only Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.634528033Z ++ git diff origin/master --name-only Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.644991507Z + echo 'Deleted BUILD files: sparkRapids/BUILD' Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.645074542Z Deleted BUILD files: sparkRapids/BUILD Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.646550288Z Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.646627246Z + echo 'Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD' Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647222183Z + [[ 1 -gt 0 ]] Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647233874Z + echo 'All tests will be run: the following BUILD files '\''sparkRapids/BUILD'\'' were removed' Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647252224Z + TESTS_TO_RUN=(":DataprocInitActionsTestSuite") Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647304225Z + return 0 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647313125Z + run_tests Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647320770Z + local -r max_parallel_tests=10 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647346445Z All tests will be run: the following BUILD files 'sparkRapids/BUILD' were removed Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.647982770Z + bazel test --jobs=10 --local_test_jobs=10 --flaky_test_attempts=3 --action_env=INTERNAL_IP_SSH=true --test_output=errors --noshow_progress --noshow_loading_progress --test_arg=--image_version=1.5-rocky8 :DataprocInitActionsTestSuite Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650667367Z + echo 'Deleted BUILD files: sparkRapids/BUILD' Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650784207Z + echo 'Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD' Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650797877Z + [[ 1 -gt 0 ]] Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650808438Z + echo 'All tests will be run: the following BUILD files '\''sparkRapids/BUILD'\'' were removed' Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650816932Z + TESTS_TO_RUN=(":DataprocInitActionsTestSuite") Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650824378Z + return 0 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650844540Z + run_tests Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650852301Z + local -r max_parallel_tests=10 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650860476Z + bazel test --jobs=10 --local_test_jobs=10 --flaky_test_attempts=3 --action_env=INTERNAL_IP_SSH=true --test_output=errors --noshow_progress --noshow_loading_progress --test_arg=--image_version=2.0-debian10 :DataprocInitActionsTestSuite Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650753258Z Deleted BUILD files: sparkRapids/BUILD Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.650894816Z Changed files: BUILD spark-rapids/README.md spark-rapids/__init__.py spark-rapids/spark-rapids.sh spark-rapids/test_spark_rapids.py spark-rapids/verify_xgboost_spark_rapids.scala sparkRapids/BUILD Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.651001494Z All tests will be run: the following BUILD files 'sparkRapids/BUILD' were removed Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:12.910039365Z Extracting Bazel installation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:12.910039367Z Extracting Bazel installation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:49:16.684331845Z Starting local Bazel server and connecting to it... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:49:19.024316946Z Starting local Bazel server and connecting to it... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:49:19.042781076Z Starting local Bazel server and connecting to it... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:51.217984603Z INFO: Analyzed 32 targets (82 packages loaded, 718 targets configured). Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T05:49:51.304573043Z INFO: Found 32 test targets... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:49:57.206233341Z INFO: Analyzed 32 targets (82 packages loaded, 718 targets configured). Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T05:49:57.280901183Z INFO: Found 32 test targets... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:50:03.767361899Z INFO: Analyzed 32 targets (82 packages loaded, 718 targets configured). Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T05:50:03.844231231Z INFO: Found 32 test targets... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:50:18.112041365Z INFO: Analyzed 32 targets (82 packages loaded, 718 targets configured). Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:50:18.128033788Z INFO: Analyzed 32 targets (82 packages loaded, 718 targets configured). Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T05:50:18.186146471Z INFO: Found 32 test targets... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T05:50:18.272251457Z INFO: Found 32 test targets... Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T05:53:01+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:53:01+00:00 --timestamps=true Step #5 - "dataproc-2.0-debian10-tests": ++ date --iso-8601=seconds Step #5 - "dataproc-2.0-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T05:53:18+00:00 Step #5 - "dataproc-2.0-debian10-tests": + grep -q Terminated Step #2 - "dataproc-1.5-debian10-tests": ++ date --iso-8601=seconds Step #2 - "dataproc-1.5-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T05:53:18+00:00 Step #2 - "dataproc-1.5-debian10-tests": + grep -q Terminated Step #2 - "dataproc-1.5-debian10-tests": + kubectl describe pod/presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + kubectl describe pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": + kubectl logs -f presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:53:18+00:00 --timestamps=true Step #5 - "dataproc-2.0-debian10-tests": + kubectl logs -f presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:53:18+00:00 --timestamps=true Step #7 - "dataproc-2.0-ubuntu18-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T05:54:18+00:00 Step #3 - "dataproc-1.5-rocky8-tests": + grep -q Terminated Step #3 - "dataproc-1.5-rocky8-tests": + kubectl describe pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T05:54:18+00:00 Step #7 - "dataproc-2.0-ubuntu18-tests": + grep -q Terminated Step #7 - "dataproc-2.0-ubuntu18-tests": + kubectl describe pod/presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": + kubectl logs -f presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:54:18+00:00 --timestamps=true Step #3 - "dataproc-1.5-rocky8-tests": + kubectl logs -f presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:54:18+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T05:54:51+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:54:51+00:00 --timestamps=true Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:57:05.998724256Z FAIL: //ranger:test_ranger (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T05:57:28.297536672Z FAIL: //ranger:test_ranger (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T05:57:51+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T05:57:51+00:00 --timestamps=true Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T06:00:28+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:00:28+00:00 --timestamps=true Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:00:44.438289288Z FAIL: //solr:test_solr (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_2_of_3/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": ++ date --iso-8601=seconds Step #5 - "dataproc-2.0-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T06:01:01+00:00 Step #5 - "dataproc-2.0-debian10-tests": + grep -q Terminated Step #5 - "dataproc-2.0-debian10-tests": + kubectl describe pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + kubectl logs -f presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:01:01+00:00 --timestamps=true Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:01:27.797350662Z FAIL: //solr:test_solr (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_1_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:01:52+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:01:52+00:00 --timestamps=true Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:02:00.996415237Z FAIL: //ranger:test_ranger (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:02:01.762152375Z FAIL: //solr:test_solr (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_3_of_3/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:02:41.770546459Z FAIL: //ranger:test_ranger (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:04:05.255664901Z FAIL: //solr:test_solr (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_2_of_3/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:05:22+00:00 Step #3 - "dataproc-1.5-rocky8-tests": + grep -q Terminated Step #3 - "dataproc-1.5-rocky8-tests": + kubectl describe pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + kubectl logs -f presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:05:22+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:05:41+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T06:05:41+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:05:41+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:05:41+00:00 --timestamps=true Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:06:20.911979041Z FAIL: //solr:test_solr (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_1_of_3/test_attempts/attempt_2.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:06:29.483868776Z FAIL: //ranger:test_ranger (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:06:50.703757719Z FAIL: //conda:test_conda (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.798211173Z FAIL: //ranger:test_ranger (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.882864636Z INFO: From Testing //ranger:test_ranger (shard 2 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888366213Z ==================== Test output for //ranger:test_ranger (shard 2 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888435331Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888461991Z [ RUN ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888475834Z [ FAILED ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888485622Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888495875Z FAIL: test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888505393Z test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888516153Z test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888527647Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888538009Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888548839Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888579229Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888589250Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888598682Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888607914Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888617761Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888627544Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888637220Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888647350Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888662327Z gcloud dataproc clusters create test-ranger-standard-1-5-20221203-055230-uke8 --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055057-0wyk/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055057-0wyk/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888677358Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888687344Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888697707Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888708922Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/393fdeeb-4663-3c41-a1fb-1f9f4c764766]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888719353Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888729760Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888742361Z .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888760477Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/393fdeeb-4663-3c41-a1fb-1f9f4c764766] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055057-0wyk/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ea4945de-5749-4b37-8df2-fb8004c8db25/test-ranger-standard-1-5-20221203-055230-uke8-m/dataproc-initialization-script-0_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888783364Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055057-0wyk/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ea4945de-5749-4b37-8df2-fb8004c8db25/test-ranger-standard-1-5-20221203-055230-uke8-m/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888793601Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888803353Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888813361Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888823697Z Ran 1 test in 472.205s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888833428Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888843844Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888854299Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888864598Z ==================== Test output for //ranger:test_ranger (shard 2 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888875376Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888885551Z [ RUN ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888895942Z [ FAILED ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888906198Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888916104Z FAIL: test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888926527Z test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888936327Z test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888946395Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888956858Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888967479Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888977968Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888988260Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.888998634Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889008846Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889018475Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889028750Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889038913Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889049330Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889059306Z gcloud dataproc clusters create test-ranger-standard-1-5-20221203-055724-busv --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055715-i016/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055715-i016/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889078163Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889087927Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889098339Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889108492Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/2668546b-63ee-3335-aeff-773f52e0740e]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889118433Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.889128106Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898260470Z ...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898319871Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/2668546b-63ee-3335-aeff-773f52e0740e] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055715-i016/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/9c6dcb2d-067e-41fd-b106-16e0e31fad91/test-ranger-standard-1-5-20221203-055724-busv-m/dataproc-initialization-script-0_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898335444Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055715-i016/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/9c6dcb2d-067e-41fd-b106-16e0e31fad91/test-ranger-standard-1-5-20221203-055724-busv-m/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898347188Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898358633Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898370593Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898382189Z Ran 1 test in 291.771s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898391845Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898402713Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898413581Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898424808Z ==================== Test output for //ranger:test_ranger (shard 2 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898435969Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898446741Z [ RUN ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898479268Z [ FAILED ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898492499Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898502324Z FAIL: test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898531510Z test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898541386Z test_ranger('STANDARD', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898550479Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898560887Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898578710Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898588894Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898606247Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898616529Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898626593Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898636179Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898646211Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898655905Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898665164Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898685162Z gcloud dataproc clusters create test-ranger-standard-1-5-20221203-060351-0to0 --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060314-osoo/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060314-osoo/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898695821Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898705500Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898715016Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898724957Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/cde92602-6de4-3190-b78d-aa04d893544d]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898735394Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898745439Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898765488Z .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898788222Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/cde92602-6de4-3190-b78d-aa04d893544d] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060314-osoo/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/90e4976e-5824-4e0c-8e6c-b948d71b9e7c/test-ranger-standard-1-5-20221203-060351-0to0-m/dataproc-initialization-script-0_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898799085Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060314-osoo/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/90e4976e-5824-4e0c-8e6c-b948d71b9e7c/test-ranger-standard-1-5-20221203-060351-0to0-m/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898808967Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898818400Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898829720Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898840488Z Ran 1 test in 375.595s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898849893Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898859658Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:20.898869684Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:33.025800747Z FAIL: //solr:test_solr (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_3_of_3/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:08:42+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:08:42+00:00 --timestamps=true Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.306252270Z FAIL: //solr:test_solr (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_2_of_3/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.403660109Z INFO: From Testing //solr:test_solr (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408325391Z ==================== Test output for //solr:test_solr (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408406209Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408416568Z [ RUN ] SolrTestCase.test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408423841Z [ FAILED ] SolrTestCase.test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408430859Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408441217Z FAIL: test_solr('STANDARD', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408448883Z test_solr('STANDARD', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408472496Z test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408479909Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408486944Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408498914Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408521684Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408529288Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 44, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408535956Z self.createCluster(configuration, self.INIT_ACTIONS) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408557741Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408565910Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408576109Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408584416Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408616705Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408650758Z gcloud dataproc clusters create test-solr-standard-1-5-20221203-055759-fy26 --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055719-9kbf/solr/solr.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408661764Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408669868Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408676685Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408700614Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/a48b7834-986f-3db4-bf6d-2c1d9f29b07b]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408708753Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408718419Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408729377Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408741478Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/a48b7834-986f-3db4-bf6d-2c1d9f29b07b] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055719-9kbf/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e2a59e20-d5b1-4d18-b71f-57db432c08c3/test-solr-standard-1-5-20221203-055759-fy26-m/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408748566Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408755741Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408763276Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408789591Z Ran 1 test in 284.283s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408798473Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408806312Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408813939Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408829829Z ==================== Test output for //solr:test_solr (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408838066Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408873741Z [ RUN ] SolrTestCase.test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408882866Z [ FAILED ] SolrTestCase.test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408890186Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408897398Z FAIL: test_solr('STANDARD', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408904406Z test_solr('STANDARD', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408911578Z test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408919189Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408929125Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408961899Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408970239Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408977913Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 44, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408985648Z self.createCluster(configuration, self.INIT_ACTIONS) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.408995565Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409004146Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409011970Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409019801Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409044455Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409054843Z gcloud dataproc clusters create test-solr-standard-1-5-20221203-060058-zhqy --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060052-igqc/solr/solr.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409063671Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409071346Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409079160Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409086360Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/355ca674-6804-3689-8b09-20a330284a74]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409093256Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409100678Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409125982Z .............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409143336Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/355ca674-6804-3689-8b09-20a330284a74] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060052-igqc/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/9586cfea-7c4c-463d-bd8d-ba2f42195e24/test-solr-standard-1-5-20221203-060058-zhqy-m/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409151103Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409157861Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409165133Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409172869Z Ran 1 test in 199.406s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409180307Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409206268Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409215126Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409222546Z ==================== Test output for //solr:test_solr (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409230536Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409238063Z [ RUN ] SolrTestCase.test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.409260680Z [ FAILED ] SolrTestCase.test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.416884442Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.416960292Z FAIL: test_solr('STANDARD', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.416970217Z test_solr('STANDARD', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.416980727Z test_solr('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.416988696Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.416996177Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417017569Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417025207Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417032817Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 44, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417042371Z self.createCluster(configuration, self.INIT_ACTIONS) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417050441Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417057961Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417064975Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417072106Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417079007Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417091327Z gcloud dataproc clusters create test-solr-standard-1-5-20221203-060546-5fhg --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060520-eut7/solr/solr.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417113371Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417122576Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417131482Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417139379Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1e3b8a7f-d620-3b70-a911-cc2bb47394ae]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417146513Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417153441Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417162844Z ..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417171824Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1e3b8a7f-d620-3b70-a911-cc2bb47394ae] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060520-eut7/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c8fccdb6-772b-49c7-a3c0-d3606d6994be/test-solr-standard-1-5-20221203-060546-5fhg-m/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417178516Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417187686Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417196364Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417203474Z Ran 1 test in 285.457s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417209996Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417216846Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:08:56.417223996Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.597206231Z FAIL: //ranger:test_ranger (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.607703656Z INFO: From Testing //ranger:test_ranger (shard 1 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678750293Z ==================== Test output for //ranger:test_ranger (shard 1 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678846242Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678859103Z [ RUN ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678889797Z [ FAILED ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678902449Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678911635Z FAIL: test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678921100Z test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678931041Z test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678939740Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678948615Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.678991678Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679001924Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679010613Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679018795Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679026536Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679034704Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679082665Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679091659Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679099524Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679110779Z gcloud dataproc clusters create test-ranger-single-1-5-20221203-055227-o6qb --single-node --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055055-up1t/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055055-up1t/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679119467Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679127472Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679134737Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679143454Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8e883785-ab1d-393d-942d-435992326e61]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679171022Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679179122Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679188427Z .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679212576Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8e883785-ab1d-393d-942d-435992326e61] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055055-up1t/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c3b8a921-a37d-497a-a10d-c02f1ccd4637/test-ranger-single-1-5-20221203-055227-o6qb-m/dataproc-initialization-script-0_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679222474Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055055-up1t/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c3b8a921-a37d-497a-a10d-c02f1ccd4637/test-ranger-single-1-5-20221203-055227-o6qb-m/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679259604Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679282496Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679292233Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679300609Z Ran 1 test in 494.607s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679308371Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679336313Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679345918Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679354844Z ==================== Test output for //ranger:test_ranger (shard 1 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679367004Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679378237Z [ RUN ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679386388Z [ FAILED ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679394646Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679420177Z FAIL: test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679429599Z test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679440564Z test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679476390Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679487564Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679495727Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679507998Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679518078Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679527286Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679535326Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679564593Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679573613Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679581054Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679588764Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679596598Z gcloud dataproc clusters create test-ranger-single-1-5-20221203-055743-wxak --single-node --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055736-hpzc/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055736-hpzc/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679604556Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679615069Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679625477Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679655562Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f239743e-f0b2-3544-8e80-1949af379ad2]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679669518Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.679678075Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690584742Z ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690655347Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f239743e-f0b2-3544-8e80-1949af379ad2] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055736-hpzc/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/77610a3f-e3eb-45c1-be44-cea3e131288f/test-ranger-single-1-5-20221203-055743-wxak-m/dataproc-initialization-script-0_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690667676Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055736-hpzc/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/77610a3f-e3eb-45c1-be44-cea3e131288f/test-ranger-single-1-5-20221203-055743-wxak-m/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690676630Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690684622Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690694388Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690722334Z Ran 1 test in 311.661s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690731087Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690738780Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690746233Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690753816Z ==================== Test output for //ranger:test_ranger (shard 1 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690762871Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690770714Z [ RUN ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690779167Z [ FAILED ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690805540Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690814370Z FAIL: test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690821742Z test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690828945Z test_ranger('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690835977Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690851117Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690859832Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690921287Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690931973Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690939267Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690946732Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690953840Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690961508Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.690985794Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691012747Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691021053Z gcloud dataproc clusters create test-ranger-single-1-5-20221203-060412-vqe6 --single-node --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060349-r42x/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060349-r42x/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691028536Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691035395Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691042517Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691074498Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/fd467d49-0375-3104-becb-f2a7cc055951]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691082665Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691089990Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691097857Z ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691105326Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/fd467d49-0375-3104-becb-f2a7cc055951] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060349-r42x/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/888cf0da-320c-4c72-8276-4ab5cab63b60/test-ranger-single-1-5-20221203-060412-vqe6-m/dataproc-initialization-script-0_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691122410Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060349-r42x/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/888cf0da-320c-4c72-8276-4ab5cab63b60/test-ranger-single-1-5-20221203-060412-vqe6-m/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691129313Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691152916Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691160819Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691168035Z Ran 1 test in 369.484s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691174953Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691183168Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:08:56.691190434Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:09:10.408633712Z FAIL: //gpu:test_gpu (shard 2 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_2_of_15/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.013875438Z FAIL: //solr:test_solr (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_1_of_3/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.019018029Z INFO: From Testing //solr:test_solr (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.232036237Z ==================== Test output for //solr:test_solr (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.233482321Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.234466459Z [ RUN ] SolrTestCase.test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.235170656Z [ FAILED ] SolrTestCase.test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.235935521Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.236566939Z FAIL: test_solr('SINGLE', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.237191082Z test_solr('SINGLE', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.237804516Z test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.238417845Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.239054686Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.239687062Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.240297042Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.240845266Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 44, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.241373341Z self.createCluster(configuration, self.INIT_ACTIONS) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.243999436Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.244563764Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.245088309Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.245589514Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.246067306Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.246574210Z gcloud dataproc clusters create test-solr-single-1-5-20221203-055800-ogmv --single-node --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055721-kukx/solr/solr.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.250427881Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.251146085Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.252027787Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.252741920Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/35eb6230-831b-336e-ad55-3aea8cb11f79]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.253410334Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.254064434Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.254750935Z ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.255357565Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/35eb6230-831b-336e-ad55-3aea8cb11f79] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055721-kukx/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3cf5dc85-0981-4360-8b30-329b6cbe7a2f/test-solr-single-1-5-20221203-055800-ogmv-m/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.259374804Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.260148579Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.261020852Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.265382599Z Ran 1 test in 328.651s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.268340201Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.270701913Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.272021599Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.273084324Z ==================== Test output for //solr:test_solr (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.273908656Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.274492268Z [ RUN ] SolrTestCase.test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.274573256Z [ FAILED ] SolrTestCase.test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.274588083Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275302700Z FAIL: test_solr('SINGLE', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275320483Z test_solr('SINGLE', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275328586Z test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275336193Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275343509Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275350930Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275477217Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275492114Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 44, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275500394Z self.createCluster(configuration, self.INIT_ACTIONS) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275507929Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.275523176Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276131412Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276149361Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276158016Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276166007Z gcloud dataproc clusters create test-solr-single-1-5-20221203-060251-6cwi --single-node --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060210-c6m1/solr/solr.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276173908Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276180621Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276415842Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276548677Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/cbcfa162-a3fe-3ab1-be8c-e4f7b12aca30]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276564876Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276575927Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276584303Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276731979Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/cbcfa162-a3fe-3ab1-be8c-e4f7b12aca30] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060210-c6m1/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a6357262-81d0-4afc-8c0c-276d309d4a30/test-solr-single-1-5-20221203-060251-6cwi-m/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276746474Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276754476Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276762569Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276770353Z Ran 1 test in 292.454s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276777222Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.276784027Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.278655111Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.278675089Z ==================== Test output for //solr:test_solr (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.278683204Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279124611Z [ RUN ] SolrTestCase.test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279134818Z [ FAILED ] SolrTestCase.test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279142175Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279149514Z FAIL: test_solr('SINGLE', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279159273Z test_solr('SINGLE', ['m']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279168087Z test_solr('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279425740Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279556083Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279571850Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279579543Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279587173Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 44, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279616047Z self.createCluster(configuration, self.INIT_ACTIONS) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279625672Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279635651Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279644258Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279651653Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.279673691Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.280824568Z gcloud dataproc clusters create test-solr-single-1-5-20221203-060637-iomb --single-node --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060629-2euz/solr/solr.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281336646Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281357193Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281365455Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281373228Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b029f3a0-74b3-3de7-890f-85a59487c891]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281492033Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281505868Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281521767Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281530509Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b029f3a0-74b3-3de7-890f-85a59487c891] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060629-2euz/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/70b2ae03-d916-4ab9-87c0-8930454f6a9e/test-solr-single-1-5-20221203-060637-iomb-m/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281537269Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281544278Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281611768Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281625151Z Ran 1 test in 206.087s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281632111Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281638795Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:09:48.281661834Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T06:10:56+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:10:56+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:12:00.461369282Z FAIL: //gpu:test_gpu (shard 7 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_7_of_15/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:13:19.193876167Z FAIL: //gpu:test_gpu (shard 5 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_5_of_15/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.333272536Z FAIL: //solr:test_solr (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_3_of_3/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.341806123Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342229036Z FAILED: //solr:test_solr (Summary) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342288010Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_2_of_3/test.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342301234Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_2_of_3/test_attempts/attempt_1.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342310092Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_2_of_3/test_attempts/attempt_2.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342334263Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_1_of_3/test.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342341671Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_1_of_3/test_attempts/attempt_1.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342349419Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_1_of_3/test_attempts/attempt_2.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342356636Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_3_of_3/test.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342366137Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_3_of_3/test_attempts/attempt_1.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.342374225Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/solr/test_solr/shard_3_of_3/test_attempts/attempt_2.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.351712504Z INFO: From Testing //solr:test_solr (shard 3 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414209581Z ==================== Test output for //solr:test_solr (shard 3 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414375890Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414412090Z [ RUN ] SolrTestCase.test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414447208Z [ FAILED ] SolrTestCase.test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414458683Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414466358Z FAIL: test_solr('HA', ['m-0']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414473951Z test_solr('HA', ['m-0']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414481415Z test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414488807Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414495206Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414530846Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414541807Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414550618Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 46, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414558368Z self.verify_instance("{}-{}".format(self.getClusterName(), Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414568715Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 24, in verify_instance Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414577433Z self.__run_test_script(name) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414585247Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 28, in __run_test_script Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414733661Z self.assert_instance_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414750339Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414855753Z ret_code, stdout, stderr = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.414867633Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.415931621Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.415940793Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.415949261Z gcloud compute ssh test-solr-ha-1-5-20221203-055803-otjr-m-0 --zone=us-central1-f --command="python3 verify_solr.py" Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.415968489Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.415984477Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.415992596Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416000264Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416010430Z File "verify_solr.py", line 95, in Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416017963Z main() Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416025271Z File "verify_solr.py", line 90, in main Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416032564Z post_test_data() Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416054128Z File "verify_solr.py", line 66, in post_test_data Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416063443Z assert ret_code == 0, "Failed to get test data. Error: {}".format(stderr) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416073076Z AssertionError: Failed to get test data. Error: https://raw.githubusercontent.com/apache/lucene-solr/master/solr/example/films/films.json: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416080435Z 2022-12-03 06:01:40 ERROR 404: Not Found. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416087270Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416094121Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416103502Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416111966Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416119406Z Ran 1 test in 361.230s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416126286Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416133530Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416140998Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416148363Z ==================== Test output for //solr:test_solr (shard 3 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416155663Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416165769Z [ RUN ] SolrTestCase.test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416173787Z [ FAILED ] SolrTestCase.test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416181273Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416188568Z FAIL: test_solr('HA', ['m-0']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416195853Z test_solr('HA', ['m-0']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416202976Z test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416210288Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416217431Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416227866Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416236147Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416252173Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 46, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416259594Z self.verify_instance("{}-{}".format(self.getClusterName(), Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416275743Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 24, in verify_instance Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416283411Z self.__run_test_script(name) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416304755Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 28, in __run_test_script Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416312305Z self.assert_instance_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416322534Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416330910Z ret_code, stdout, stderr = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416348906Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416356866Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416364141Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416371579Z gcloud compute ssh test-solr-ha-1-5-20221203-060410-9yc1-m-0 --zone=us-central1-f --command="python3 verify_solr.py" Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416378913Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416388343Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416397018Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416404388Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416411764Z File "verify_solr.py", line 95, in Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416430561Z main() Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416437779Z File "verify_solr.py", line 90, in main Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416447728Z post_test_data() Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416455941Z File "verify_solr.py", line 66, in post_test_data Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416463388Z assert ret_code == 0, "Failed to get test data. Error: {}".format(stderr) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416472343Z AssertionError: Failed to get test data. Error: https://raw.githubusercontent.com/apache/lucene-solr/master/solr/example/films/films.json: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416479686Z 2022-12-03 06:08:29 ERROR 404: Not Found. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416486940Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416493815Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416500638Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416510572Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416518911Z Ran 1 test in 386.808s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416525926Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416533068Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416540421Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416547608Z ==================== Test output for //solr:test_solr (shard 3 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416554738Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416561881Z [ RUN ] SolrTestCase.test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416572026Z [ FAILED ] SolrTestCase.test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416580273Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416587666Z FAIL: test_solr('HA', ['m-0']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.416606463Z test_solr('HA', ['m-0']) (__main__.SolrTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.421643113Z test_solr('HA', ['m-0']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.423131363Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.423881702Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.424625079Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.425316943Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.425984265Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 46, in test_solr Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.429695968Z self.verify_instance("{}-{}".format(self.getClusterName(), Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.430519353Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 24, in verify_instance Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.431246025Z self.__run_test_script(name) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.431958862Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/solr/test_solr.py", line 28, in __run_test_script Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.435668692Z self.assert_instance_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.437306724Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.438550025Z ret_code, stdout, stderr = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.440254119Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/solr/test_solr.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.441864198Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.443323079Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.446427960Z gcloud compute ssh test-solr-ha-1-5-20221203-060852-p8wl-m-0 --zone=us-central1-f --command="python3 verify_solr.py" Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.447584421Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.448982397Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.450503439Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451858514Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451886886Z File "verify_solr.py", line 95, in Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451896700Z main() Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451904022Z File "verify_solr.py", line 90, in main Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451911532Z post_test_data() Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451918676Z File "verify_solr.py", line 66, in post_test_data Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451934980Z assert ret_code == 0, "Failed to get test data. Error: {}".format(stderr) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451943358Z AssertionError: Failed to get test data. Error: https://raw.githubusercontent.com/apache/lucene-solr/master/solr/example/films/films.json: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451953046Z 2022-12-03 06:13:42 ERROR 404: Not Found. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451960836Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451967501Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451974263Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451981364Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451988236Z Ran 1 test in 335.607s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.451994801Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.452002075Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:14:11.452011721Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:14:19+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:14:19+00:00 --timestamps=true Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:14:42.674187191Z FAIL: //horovod:test_horovod (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:15:17.170764238Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T06:16:17+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #5 - "dataproc-2.0-debian10-tests": ++ date --iso-8601=seconds Step #5 - "dataproc-2.0-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T06:16:17+00:00 Step #5 - "dataproc-2.0-debian10-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + kubectl describe pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:16:17+00:00 --timestamps=true Step #5 - "dataproc-2.0-debian10-tests": + kubectl logs -f presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:16:17+00:00 --timestamps=true Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:18:13.318849772Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:18:39.226269209Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:20:01+00:00 Step #3 - "dataproc-1.5-rocky8-tests": + grep -q Terminated Step #3 - "dataproc-1.5-rocky8-tests": + kubectl describe pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:20:01+00:00 Step #6 - "dataproc-2.0-rocky8-tests": + grep -q Terminated Step #6 - "dataproc-2.0-rocky8-tests": + kubectl describe pod/presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": + kubectl logs -f presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:20:01+00:00 --timestamps=true Step #3 - "dataproc-1.5-rocky8-tests": + kubectl logs -f presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:20:01+00:00 --timestamps=true Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:21:21.584910457Z FAIL: //conda:test_conda (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test_attempts/attempt_2.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:21:35.771233043Z FAIL: //ranger:test_ranger (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test_attempts/attempt_2.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:22:21.310348391Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:22:25.028905292Z FAIL: //:test_cloud_sql_proxy (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:22:39.521949137Z FAIL: //bigtable:test_bigtable (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:15.730486797Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:15.843585073Z INFO: From Testing //h2o:test_h2o (shard 1 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025481436Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025563625Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025579345Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025591193Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025599040Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025607160Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025615214Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025623561Z test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025631778Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025639882Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025652458Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025660687Z test_method(self, testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025669319Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025676498Z self.createCluster(configuration, Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025683378Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025714208Z _, stdout, _ = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025721265Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025727807Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025734717Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025759010Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-061248-r9lj --num-masters=1 --num-workers=2 --image-version=2.0-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061240-6wwb/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025767271Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025774408Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025782033Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025790135Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b9e2d527-acd4-38f2-a849-97456d899128]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025798138Z Waiting for cluster creation operation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025806367Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025815335Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025827513Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b9e2d527-acd4-38f2-a849-97456d899128] failed: Multiple Errors: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025836575Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061240-6wwb/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/48f9ad3e-a20d-4908-8163-69c7761310d9/test-h2o-standard-2-0-20221203-061248-r9lj-m/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025844325Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061240-6wwb/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/48f9ad3e-a20d-4908-8163-69c7761310d9/test-h2o-standard-2-0-20221203-061248-r9lj-w-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025859853Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061240-6wwb/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/48f9ad3e-a20d-4908-8163-69c7761310d9/test-h2o-standard-2-0-20221203-061248-r9lj-w-1/dataproc-initialization-script-0_output. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025868184Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025875818Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025884523Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025892674Z Ran 1 test in 165.494s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025931161Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025942745Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025950564Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025958797Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025966795Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025974971Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.025983128Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026051330Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026062748Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026070956Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026078944Z test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026087065Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026094799Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026102792Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026128811Z test_method(self, testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026138391Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026146142Z self.createCluster(configuration, Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026154367Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026194139Z _, stdout, _ = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026203905Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026211944Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026219768Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026228284Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-061606-1qd8 --num-masters=1 --num-workers=2 --image-version=2.0-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061544-3f14/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026236553Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026244433Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026270851Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026279940Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1c40bbd2-21d1-37e5-8158-abb996e7615e]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026288138Z Waiting for cluster creation operation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026297105Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026305423Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.026347948Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1c40bbd2-21d1-37e5-8158-abb996e7615e] failed: Multiple Errors: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.033846135Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061544-3f14/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/37aadf24-b79c-4911-b3d6-fa7ae5682457/test-h2o-standard-2-0-20221203-061606-1qd8-m/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.033947024Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061544-3f14/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/37aadf24-b79c-4911-b3d6-fa7ae5682457/test-h2o-standard-2-0-20221203-061606-1qd8-w-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.033967774Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061544-3f14/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/37aadf24-b79c-4911-b3d6-fa7ae5682457/test-h2o-standard-2-0-20221203-061606-1qd8-w-1/dataproc-initialization-script-0_output. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.033977120Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.033986170Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.033994474Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034002625Z Ran 1 test in 199.772s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034029340Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034038163Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034045951Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034053494Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034060841Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034068491Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034075847Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034082938Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034090618Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034098534Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034105938Z test_h2o('STANDARD') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034113771Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034121860Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034130423Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034138116Z test_method(self, testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034147098Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034155199Z self.createCluster(configuration, Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034163744Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034172262Z _, stdout, _ = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034197631Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034206238Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034214667Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034223629Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-062012-h7oz --num-masters=1 --num-workers=2 --image-version=2.0-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061945-gshq/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034232005Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034239625Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034248363Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034257508Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/806b77ae-422f-3c6d-ab04-c10ce1308af5]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034305338Z Waiting for cluster creation operation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034336050Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034353690Z ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034363390Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/806b77ae-422f-3c6d-ab04-c10ce1308af5] failed: Multiple Errors: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034372122Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061945-gshq/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5299b83a-d30a-455c-a631-daa3e67af103/test-h2o-standard-2-0-20221203-062012-h7oz-m/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034382780Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061945-gshq/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5299b83a-d30a-455c-a631-daa3e67af103/test-h2o-standard-2-0-20221203-062012-h7oz-w-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034390961Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061945-gshq/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5299b83a-d30a-455c-a631-daa3e67af103/test-h2o-standard-2-0-20221203-062012-h7oz-w-1/dataproc-initialization-script-0_output. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034398632Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034406202Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034414332Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034422338Z Ran 1 test in 273.024s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034430171Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034446916Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:23:16.034465659Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:23:24.831147328Z FAIL: //bigtable:test_bigtable (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:23:25.839852545Z FAIL: //bigtable:test_bigtable (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:24:56.593801641Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": ++ date --iso-8601=seconds Step #5 - "dataproc-2.0-debian10-tests": + LOGS_SINCE_TIME=2022-12-03T06:25:16+00:00 Step #5 - "dataproc-2.0-debian10-tests": + kubectl describe pod/presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": + grep -q Terminated Step #5 - "dataproc-2.0-debian10-tests": + kubectl logs -f presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:25:16+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:26:47.046066496Z FAIL: //gpu:test_gpu (shard 2 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_2_of_15/test_attempts/attempt_2.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.922511362Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946066802Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946268457Z FAILED: //h2o:test_h2o (Summary) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946311560Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946324022Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_1.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946332154Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_2.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946339277Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946346514Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_1.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.946353785Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_2.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.987134824Z INFO: From Testing //h2o:test_h2o (shard 2 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997131558Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997255322Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997286498Z [ RUN ] H2OTestCase.test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997295900Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997304294Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997312453Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997319802Z test_h2o('HA') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997329470Z test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997337961Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997345029Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997383090Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997391464Z test_method(self, testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997400126Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997407905Z self.createCluster(configuration, Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997415582Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997423241Z _, stdout, _ = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997431343Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997456912Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997498510Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997511123Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-061447-nzdw --num-masters=3 --num-workers=2 --image-version=2.0-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061423-c8df/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997538869Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997547905Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997556601Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997566683Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/573f5524-b9aa-3805-9de3-c53030157ff0]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997575701Z Waiting for cluster creation operation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997584284Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997642492Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997654495Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/573f5524-b9aa-3805-9de3-c53030157ff0] failed: Multiple Errors: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997666124Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061423-c8df/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7db94505-0115-4660-8a70-9ad92aba1dea/test-h2o-ha-2-0-20221203-061447-nzdw-m-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997738216Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061423-c8df/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7db94505-0115-4660-8a70-9ad92aba1dea/test-h2o-ha-2-0-20221203-061447-nzdw-m-1/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997747895Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061423-c8df/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7db94505-0115-4660-8a70-9ad92aba1dea/test-h2o-ha-2-0-20221203-061447-nzdw-m-2/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997755395Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061423-c8df/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7db94505-0115-4660-8a70-9ad92aba1dea/test-h2o-ha-2-0-20221203-061447-nzdw-w-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997763324Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061423-c8df/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7db94505-0115-4660-8a70-9ad92aba1dea/test-h2o-ha-2-0-20221203-061447-nzdw-w-1/dataproc-initialization-script-0_output. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997780506Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997809000Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997818564Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997828300Z Ran 1 test in 252.323s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997835761Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997845059Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997853232Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997861939Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997870877Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997891982Z [ RUN ] H2OTestCase.test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997915247Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997926274Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997934696Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997943730Z test_h2o('HA') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997952621Z test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997981352Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.997990798Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998000615Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998009175Z test_method(self, testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998017677Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998026710Z self.createCluster(configuration, Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998035274Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998044058Z _, stdout, _ = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998070839Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998079376Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998088830Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998097831Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-061936-cj9b --num-masters=3 --num-workers=2 --image-version=2.0-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061856-9ojy/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998106453Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998115240Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998123540Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998151605Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/9821a671-71b5-3330-9f35-3e732531379c]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998161638Z Waiting for cluster creation operation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:51.998170820Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015197213Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015296921Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/9821a671-71b5-3330-9f35-3e732531379c] failed: Multiple Errors: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015312234Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061856-9ojy/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/23984cae-f02a-44a4-a8a9-c2e996d7ae69/test-h2o-ha-2-0-20221203-061936-cj9b-m-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015320857Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061856-9ojy/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/23984cae-f02a-44a4-a8a9-c2e996d7ae69/test-h2o-ha-2-0-20221203-061936-cj9b-m-1/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015328845Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061856-9ojy/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/23984cae-f02a-44a4-a8a9-c2e996d7ae69/test-h2o-ha-2-0-20221203-061936-cj9b-m-2/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015338451Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061856-9ojy/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/23984cae-f02a-44a4-a8a9-c2e996d7ae69/test-h2o-ha-2-0-20221203-061936-cj9b-w-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015347208Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061856-9ojy/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/23984cae-f02a-44a4-a8a9-c2e996d7ae69/test-h2o-ha-2-0-20221203-061936-cj9b-w-1/dataproc-initialization-script-0_output. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015354247Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015361393Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015370300Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015379185Z Ran 1 test in 244.674s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015387040Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015394652Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015402854Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015411206Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015419963Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015429607Z [ RUN ] H2OTestCase.test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015436563Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015444462Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015452286Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015459468Z test_h2o('HA') (__main__.H2OTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015495686Z test_h2o('HA') Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015503288Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015510215Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015519424Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015526400Z test_method(self, testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015533979Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015540936Z self.createCluster(configuration, Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015548420Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015556980Z _, stdout, _ = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015590786Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015598663Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015606176Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015615284Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-062416-psux --num-masters=3 --num-workers=2 --image-version=2.0-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062339-nwdh/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015623081Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015630366Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015637834Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015646720Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/a0392893-bf60-3e90-b813-22c93a417371]. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015654235Z Waiting for cluster creation operation... Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015662834Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015670914Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015678863Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/a0392893-bf60-3e90-b813-22c93a417371] failed: Multiple Errors: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015687114Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062339-nwdh/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3b8e27cb-83c8-48b9-8ac0-7a68d8d72601/test-h2o-ha-2-0-20221203-062416-psux-m-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015706104Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062339-nwdh/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3b8e27cb-83c8-48b9-8ac0-7a68d8d72601/test-h2o-ha-2-0-20221203-062416-psux-m-1/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015714651Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062339-nwdh/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3b8e27cb-83c8-48b9-8ac0-7a68d8d72601/test-h2o-ha-2-0-20221203-062416-psux-m-2/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015722660Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062339-nwdh/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3b8e27cb-83c8-48b9-8ac0-7a68d8d72601/test-h2o-ha-2-0-20221203-062416-psux-w-0/dataproc-initialization-script-0_output Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015730613Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062339-nwdh/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3b8e27cb-83c8-48b9-8ac0-7a68d8d72601/test-h2o-ha-2-0-20221203-062416-psux-w-1/dataproc-initialization-script-0_output. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015738084Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015745700Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015753722Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015761697Z Ran 1 test in 265.122s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015769159Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015777224Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:26:52.015785244Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:28:20.719468979Z FAIL: //hue:test_hue (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:28:47.199518985Z FAIL: //hue:test_hue (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:28:50.399012098Z FAIL: //hue:test_hue (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:29:02.909447022Z FAIL: //gpu:test_gpu (shard 7 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_7_of_15/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:30:12.814905760Z FAIL: //gpu:test_gpu (shard 5 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_5_of_15/test_attempts/attempt_2.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:31:22.486779318Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_2.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.011910974Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.011989837Z FLAKY: //horovod:test_horovod (Summary) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.012004277Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_1.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.070412568Z INFO: From Testing //horovod:test_horovod (shard 3 of 4): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084616269Z ==================== Test output for //horovod:test_horovod (shard 3 of 4): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084691057Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084705264Z [ RUN ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084713243Z [ FAILED ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084720835Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084728829Z FAIL: test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084736529Z test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084748958Z test_horovod_gpu('STANDARD', 'gloo') Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084756548Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084764535Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084772208Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084798471Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084808232Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/horovod/test_horovod.py", line 50, in test_horovod_gpu Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084816001Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084823785Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084831832Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084864653Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084872674Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084880821Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084890964Z gcloud dataproc clusters create test-horovod-standard-1-5-20221203-055701-vm18 --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055652-ybc9/gpu/install_gpu_driver.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055652-ybc9/horovod/horovod.sh' --initialization-action-timeout=60m --metadata=cuda-version=11.0,cudnn-version=8.0.5.39,gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-p100 --worker-accelerator=type=nvidia-tesla-p100 --master-machine-type=n1-standard-8 --worker-machine-type=n1-standard-8 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084898929Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084906220Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084914846Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084923881Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/99bcc27a-1708-39be-be3d-703333e637d9]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084931622Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084940002Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.084966558Z .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090632015Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/99bcc27a-1708-39be-be3d-703333e637d9] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055652-ybc9/horovod/horovod.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e589cf3b-053a-41b0-bb18-71318db55cde/test-horovod-standard-1-5-20221203-055701-vm18-w-0/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090707211Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090720291Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090729566Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090738141Z Ran 1 test in 1076.872s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090745440Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090754205Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:32:37.090763341Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:33:05.325899756Z FAIL: //horovod:test_horovod (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:36:26.200469774Z FAIL: //ranger:test_ranger (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test_attempts/attempt_1.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.008803334Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.070424919Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.070543393Z FAILED: //sqoop:test_sqoop (Summary) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.070565611Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.070577593Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_1.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.070586732Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_2.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.075738728Z INFO: From Testing //sqoop:test_sqoop (shard 4 of 4): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081425212Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081573408Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081592891Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081602838Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081622691Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081631571Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081643225Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081650809Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081657989Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081666030Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081675803Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081682883Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081691041Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081698649Z self.import_mysql_db(instance) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081707032Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081734244Z self.assert_instance_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081742186Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081749986Z ret_code, stdout, stderr = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081757394Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081765301Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081772728Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081782004Z gcloud compute ssh test-sqoop-single-1-5-20221203-061902-etk5-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081789883Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081797023Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081804289Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081811642Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081819100Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081826024Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081832430Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081839616Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081847259Z Ran 1 test in 388.302s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081854683Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081862143Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081868979Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081875643Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081883112Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081891057Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081899514Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081907596Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081915622Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081923031Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081931825Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081939904Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081949136Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081957398Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081964684Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081972077Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081979801Z self.import_mysql_db(instance) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.081995046Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082002557Z self.assert_instance_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082019888Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082027557Z ret_code, stdout, stderr = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082035140Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082042640Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082050083Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082057693Z gcloud compute ssh test-sqoop-single-1-5-20221203-062722-8rkv-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082065722Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082072869Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082080303Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082087852Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082095660Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082102987Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082110040Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082117523Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082124679Z Ran 1 test in 379.500s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082131729Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082139128Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082146677Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082154009Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082161430Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082168920Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082176338Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082183625Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082190860Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082198619Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082206497Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082213828Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082221096Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082228560Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082235397Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082242874Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082250237Z self.import_mysql_db(instance) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082257810Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082265446Z self.assert_instance_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082272826Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082295206Z ret_code, stdout, stderr = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082302933Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082310472Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082317890Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082325516Z gcloud compute ssh test-sqoop-single-1-5-20221203-063138-5m54-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082333100Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082340539Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082347943Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082355323Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082362837Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082370160Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082377390Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082384692Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082392145Z Ran 1 test in 311.248s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082399306Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082406677Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:36:35.082414085Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:37:10.441803213Z FAIL: //bigtable:test_bigtable (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:37:22.067962902Z FAIL: //bigtable:test_bigtable (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:37:23.538475421Z FAIL: //bigtable:test_bigtable (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:37:33.206198325Z FAIL: //ranger:test_ranger (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:38:19.339181203Z FAIL: //bigtable:test_bigtable (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_2.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.911681990Z FAIL: //conda:test_conda (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.911873333Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.911922583Z FAILED: //conda:test_conda (Summary) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.911934249Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.911944511Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test_attempts/attempt_1.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.911953343Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test_attempts/attempt_2.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.976627748Z INFO: From Testing //conda:test_conda (shard 2 of 2): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.985576980Z ==================== Test output for //conda:test_conda (shard 2 of 2): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986067125Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986137663Z [ RUN ] CondaTestCase.test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986150772Z [ FAILED ] CondaTestCase.test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986159628Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986168252Z FAIL: test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) (__main__.CondaTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986176465Z test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) (__main__.CondaTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986183850Z test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986192199Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986200553Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986234989Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986243149Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986253572Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/conda/test_conda.py", line 70, in test_conda Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986261644Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986269019Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986276026Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986283170Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986291092Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986298902Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986308948Z gcloud dataproc clusters create test-conda-standard-1-5-20221203-055228-ar2y --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055059-0jsj/conda/bootstrap-conda.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055059-0jsj/conda/install-conda-env.sh' --metadata='CONDA_PACKAGES=numpy pandas jupyter,PIP_PACKAGES=pandas-gbq' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986316980Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986323684Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986331076Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986338780Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1788bff0-f628-3992-96fe-389e2eea01c1]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986346595Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986354425Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986376552Z .............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986398272Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1788bff0-f628-3992-96fe-389e2eea01c1] failed: Multiple Errors: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986407578Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055059-0jsj/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cb20482a-e675-43f6-ac1c-1d0a332abe77/test-conda-standard-1-5-20221203-055228-ar2y-m/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:27.986416777Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055059-0jsj/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cb20482a-e675-43f6-ac1c-1d0a332abe77/test-conda-standard-1-5-20221203-055228-ar2y-w-0/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195591076Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055059-0jsj/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cb20482a-e675-43f6-ac1c-1d0a332abe77/test-conda-standard-1-5-20221203-055228-ar2y-w-1/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195693821Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195729708Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195741889Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195752219Z Ran 1 test in 1057.193s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195759325Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195766368Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195774546Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195781582Z ==================== Test output for //conda:test_conda (shard 2 of 2): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195809484Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195819999Z [ RUN ] CondaTestCase.test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195826974Z [ FAILED ] CondaTestCase.test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195834419Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195842033Z FAIL: test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) (__main__.CondaTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195849787Z test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) (__main__.CondaTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195857053Z test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195864724Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195872652Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195907408Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195915305Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195925109Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/conda/test_conda.py", line 70, in test_conda Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195933271Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195941213Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195949079Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195956945Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195987722Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.195996571Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196006736Z gcloud dataproc clusters create test-conda-standard-1-5-20221203-060716-yj3d --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060703-9k36/conda/bootstrap-conda.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060703-9k36/conda/install-conda-env.sh' --metadata='CONDA_PACKAGES=numpy pandas jupyter,PIP_PACKAGES=pandas-gbq' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196016200Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196024305Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196033105Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196043139Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/4f39ce95-b53a-3782-9cfd-4d58306e8649]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196083980Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196092845Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196111657Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196155574Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/4f39ce95-b53a-3782-9cfd-4d58306e8649] failed: Multiple Errors: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196169012Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060703-9k36/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/8a09cccb-5112-4a04-8970-51a095af3924/test-conda-standard-1-5-20221203-060716-yj3d-m/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196178110Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060703-9k36/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/8a09cccb-5112-4a04-8970-51a095af3924/test-conda-standard-1-5-20221203-060716-yj3d-w-0/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196186791Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060703-9k36/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/8a09cccb-5112-4a04-8970-51a095af3924/test-conda-standard-1-5-20221203-060716-yj3d-w-1/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196194125Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196201564Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196209935Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196238969Z Ran 1 test in 868.192s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196248473Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196256866Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196265276Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196273754Z ==================== Test output for //conda:test_conda (shard 2 of 2): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196281866Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196290516Z [ RUN ] CondaTestCase.test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196298722Z [ FAILED ] CondaTestCase.test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196329579Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196338459Z FAIL: test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) (__main__.CondaTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196347073Z test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) (__main__.CondaTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196355328Z test_conda('STANDARD', ['numpy', 'pandas', 'jupyter'], ['pandas-gbq']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196370722Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196380205Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196406742Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196416300Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196425169Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/conda/test_conda.py", line 70, in test_conda Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196442727Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196482431Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196494871Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196503352Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/conda/test_conda.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196511970Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196519990Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196528173Z gcloud dataproc clusters create test-conda-standard-1-5-20221203-062350-qumz --num-masters=1 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062248-uo1f/conda/bootstrap-conda.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062248-uo1f/conda/install-conda-env.sh' --metadata='CONDA_PACKAGES=numpy pandas jupyter,PIP_PACKAGES=pandas-gbq' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196536234Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196565525Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196576123Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196589954Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3876b47f-2a32-3401-91ef-a23e62c2f004]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196598928Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196609185Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196655535Z .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196679934Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3876b47f-2a32-3401-91ef-a23e62c2f004] failed: Multiple Errors: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196688898Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062248-uo1f/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3cf2fa55-51cd-4dbf-ae66-e3502ce1054c/test-conda-standard-1-5-20221203-062350-qumz-m/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196698174Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062248-uo1f/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3cf2fa55-51cd-4dbf-ae66-e3502ce1054c/test-conda-standard-1-5-20221203-062350-qumz-w-0/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196706252Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062248-uo1f/conda/install-conda-env.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/3cf2fa55-51cd-4dbf-ae66-e3502ce1054c/test-conda-standard-1-5-20221203-062350-qumz-w-1/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196713788Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196742776Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196752884Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196761459Z Ran 1 test in 1020.621s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196768957Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196784295Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:28.196793008Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.076413677Z FAIL: //ranger:test_ranger (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test.log) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.082877172Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083259231Z FAILED: //ranger:test_ranger (Summary) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083312067Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083323169Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test_attempts/attempt_1.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083332238Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test_attempts/attempt_2.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083340613Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083348439Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test_attempts/attempt_1.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083356330Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test_attempts/attempt_2.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083364329Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083372253Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test_attempts/attempt_1.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.083379730Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test_attempts/attempt_2.log Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.088086464Z INFO: From Testing //ranger:test_ranger (shard 3 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096219847Z ==================== Test output for //ranger:test_ranger (shard 3 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096285139Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096299085Z [ RUN ] RangerTestCase.test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096308495Z [ FAILED ] RangerTestCase.test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096317812Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096327186Z FAIL: test_ranger('HA', ['m-0']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096337221Z test_ranger('HA', ['m-0']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096347212Z test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096354827Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096363522Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096373832Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096381376Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096388893Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096412601Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096420173Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096427541Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096435047Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096443095Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096476777Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096490197Z gcloud dataproc clusters create test-ranger-ha-1-5-20221203-055156-jkrs --num-masters=3 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055047-k1i7/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055047-k1i7/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096507507Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096515830Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096524946Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096534139Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/83854fa8-6986-3b2a-a140-c259446fe310]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096542214Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096552230Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096570541Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096595293Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/83854fa8-6986-3b2a-a140-c259446fe310] failed: Multiple Errors: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096606501Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055047-k1i7/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6383a744-15ab-4a85-8215-a16aa84700d7/test-ranger-ha-1-5-20221203-055156-jkrs-m-0/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096615342Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055047-k1i7/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6383a744-15ab-4a85-8215-a16aa84700d7/test-ranger-ha-1-5-20221203-055156-jkrs-m-1/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096623243Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055047-k1i7/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6383a744-15ab-4a85-8215-a16aa84700d7/test-ranger-ha-1-5-20221203-055156-jkrs-m-2/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096630782Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096639033Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096647670Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096655629Z Ran 1 test in 1037.195s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096663644Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.096671633Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.104613340Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105019239Z ==================== Test output for //ranger:test_ranger (shard 3 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105403112Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105427043Z [ RUN ] RangerTestCase.test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105435257Z [ FAILED ] RangerTestCase.test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105442900Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105449967Z FAIL: test_ranger('HA', ['m-0']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105475654Z test_ranger('HA', ['m-0']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105484023Z test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105491278Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105499102Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105509787Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105517276Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105526605Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105533863Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105541114Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105547994Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105555401Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105562543Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105570430Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105579852Z gcloud dataproc clusters create test-ranger-ha-1-5-20221203-060648-e2jf --num-masters=3 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060638-v831/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060638-v831/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105587767Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105594518Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105602494Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105610506Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/ed0afd29-2190-3f83-ad8e-d6534e9c3735]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105617370Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105624683Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105647828Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105673090Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/ed0afd29-2190-3f83-ad8e-d6534e9c3735] failed: Multiple Errors: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105727543Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060638-v831/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/52dd712b-086a-48d9-a847-968e897983b6/test-ranger-ha-1-5-20221203-060648-e2jf-m-0/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105736520Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060638-v831/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/52dd712b-086a-48d9-a847-968e897983b6/test-ranger-ha-1-5-20221203-060648-e2jf-m-1/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105744411Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060638-v831/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/52dd712b-086a-48d9-a847-968e897983b6/test-ranger-ha-1-5-20221203-060648-e2jf-m-2/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105751950Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105758835Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105767011Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105775340Z Ran 1 test in 904.628s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105781900Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105789043Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105818172Z ================================================================================ Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105827534Z ==================== Test output for //ranger:test_ranger (shard 3 of 3): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105835588Z Running tests under Python 3.8.10: /usr/bin/python3 Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105843119Z [ RUN ] RangerTestCase.test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105850206Z [ FAILED ] RangerTestCase.test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105857829Z ====================================================================== Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105910026Z FAIL: test_ranger('HA', ['m-0']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105930400Z test_ranger('HA', ['m-0']) (__main__.RangerTestCase) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105939671Z test_ranger('HA', ['m-0']) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105947562Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105984172Z Traceback (most recent call last): Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.105992097Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106008484Z test_method(self, *testcase_params) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106016711Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106025103Z self.createCluster( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106033142Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106040926Z _, stdout, _ = self.assert_command( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106049525Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106057197Z self.assertEqual( Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106075377Z AssertionError: 1 != 0 : Failed to execute command: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106083543Z gcloud dataproc clusters create test-ranger-ha-1-5-20221203-062411-v2dw --num-masters=3 --num-workers=2 --image-version=1.5-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062303-mhu6/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062303-mhu6/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106091376Z STDOUT: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106098830Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106106727Z STDERR: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106114857Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f631b1be-4541-3abb-a5e2-29aa228df98b]. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106122423Z Waiting for cluster creation operation... Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106145082Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106197785Z ..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106219071Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f631b1be-4541-3abb-a5e2-29aa228df98b] failed: Multiple Errors: Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106227968Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062303-mhu6/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7dfb9855-68f0-4720-90cd-7a2fdb5e3178/test-ranger-ha-1-5-20221203-062411-v2dw-m-0/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.106235666Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062303-mhu6/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7dfb9855-68f0-4720-90cd-7a2fdb5e3178/test-ranger-ha-1-5-20221203-062411-v2dw-m-1/dataproc-initialization-script-1_output Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107908645Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062303-mhu6/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7dfb9855-68f0-4720-90cd-7a2fdb5e3178/test-ranger-ha-1-5-20221203-062411-v2dw-m-2/dataproc-initialization-script-1_output. Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107934321Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107943427Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107952581Z ---------------------------------------------------------------------- Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107961468Z Ran 1 test in 1034.523s Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107968219Z Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107975627Z FAILED (failures=1) Step #4 - "dataproc-1.5-ubuntu18-tests": 2022-12-03T06:38:56.107983273Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:39:07.360830301Z FAIL: //bigtable:test_bigtable (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:39:34.545014775Z FAIL: //bigtable:test_bigtable (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:40:36.823904692Z FAIL: //ranger:test_ranger (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:40:42.314699174Z FAIL: //:test_cloud_sql_proxy (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:41:14.605435943Z FAIL: //ranger:test_ranger (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test_attempts/attempt_2.log) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:42:33.392776355Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_1.log) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:42:53.670542337Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:43:57.455049747Z FAIL: //horovod:test_horovod (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.691389765Z FAIL: //gpu:test_gpu (shard 2 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_2_of_15/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.755611017Z INFO: From Testing //gpu:test_gpu (shard 2 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760850840Z ==================== Test output for //gpu:test_gpu (shard 2 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760893036Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760902944Z [ RUN ] NvidiaGpuDriverTestCase.test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760910181Z [ FAILED ] NvidiaGpuDriverTestCase.test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760919950Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_without_agent('STANDARD', ['m'], 'type=nvidia-tesla-v100', None, 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760929868Z W1203 06:09:10.015259 140199993915200 dataproc_test_case.py:204] Skipping cluster delete: name is None Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760936788Z [ SKIPPED ] NvidiaGpuDriverTestCase.test_install_gpu_without_agent('STANDARD', ['m'], 'type=nvidia-tesla-v100', None, 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760944356Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760951587Z FAIL: test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760958661Z test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760966599Z test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760973723Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760984659Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.760996479Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761003910Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761013273Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 190, in test_gpu_allocation Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761020960Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761027948Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761037517Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761044473Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761073619Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761082647Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761092500Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-055249-649b --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055131-jrou/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-v100 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761103733Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761110997Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761118352Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761125725Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8e1f3b2b-1b14-3d57-8ef0-3ea23074a181]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761133172Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761144953Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.761167325Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840342194Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8e1f3b2b-1b14-3d57-8ef0-3ea23074a181] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840393324Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055131-jrou/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b7657b24-dd0c-4adc-b059-80f13f937d65/test-gpu-standard-2-0-20221203-055249-649b-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840403029Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055131-jrou/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b7657b24-dd0c-4adc-b059-80f13f937d65/test-gpu-standard-2-0-20221203-055249-649b-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840410394Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055131-jrou/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b7657b24-dd0c-4adc-b059-80f13f937d65/test-gpu-standard-2-0-20221203-055249-649b-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840419723Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840436474Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840444255Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840452414Z Ran 2 tests in 1148.582s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840458945Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840465247Z FAILED (failures=1, skipped=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840472034Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840478919Z ==================== Test output for //gpu:test_gpu (shard 2 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840505703Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840514694Z [ RUN ] NvidiaGpuDriverTestCase.test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840522055Z [ FAILED ] NvidiaGpuDriverTestCase.test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840529196Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_without_agent('STANDARD', ['m'], 'type=nvidia-tesla-v100', None, 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840536229Z W1203 06:26:46.991792 139668247516992 dataproc_test_case.py:204] Skipping cluster delete: name is None Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840543288Z [ SKIPPED ] NvidiaGpuDriverTestCase.test_install_gpu_without_agent('STANDARD', ['m'], 'type=nvidia-tesla-v100', None, 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840550229Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840556993Z FAIL: test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840566189Z test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840575636Z test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840583857Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840591609Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840634967Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840642474Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840653804Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 190, in test_gpu_allocation Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840662094Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840669651Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840677074Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840684182Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840691217Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840698428Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840717739Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-060939-k23l --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060928-5i97/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-v100 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840728300Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840736064Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840743511Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840751219Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/20cdc755-ca88-3d8a-9592-0499e561ce2f]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840767325Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.840774656Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847176418Z ............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847243521Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/20cdc755-ca88-3d8a-9592-0499e561ce2f] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847253553Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060928-5i97/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ae4bf368-5c56-411f-af91-03a5930cf654/test-gpu-standard-2-0-20221203-060939-k23l-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847260588Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060928-5i97/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ae4bf368-5c56-411f-af91-03a5930cf654/test-gpu-standard-2-0-20221203-060939-k23l-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847270176Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060928-5i97/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ae4bf368-5c56-411f-af91-03a5930cf654/test-gpu-standard-2-0-20221203-060939-k23l-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847278541Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847285038Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847295371Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847303371Z Ran 2 tests in 1055.332s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847310129Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847316475Z FAILED (failures=1, skipped=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847323247Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847333237Z ==================== Test output for //gpu:test_gpu (shard 2 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847342605Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847350702Z [ RUN ] NvidiaGpuDriverTestCase.test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847357653Z [ FAILED ] NvidiaGpuDriverTestCase.test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847364919Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_without_agent('STANDARD', ['m'], 'type=nvidia-tesla-v100', None, 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847372963Z W1203 06:44:03.149025 139934833936192 dataproc_test_case.py:204] Skipping cluster delete: name is None Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847387967Z [ SKIPPED ] NvidiaGpuDriverTestCase.test_install_gpu_without_agent('STANDARD', ['m'], 'type=nvidia-tesla-v100', None, 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847395089Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847405177Z FAIL: test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847412769Z test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847420019Z test_gpu_allocation('STANDARD', 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', 'NVIDIA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847427195Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847434321Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847441860Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847448811Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847460777Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 190, in test_gpu_allocation Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847470716Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847479533Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847487048Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847493811Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847500658Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847507504Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847515433Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-062700-9b7p --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062654-7cp0/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-v100 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847522511Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847531441Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847539534Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847547203Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/01ca692f-889e-3d4a-9bdd-687e119aec70]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847554263Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847561843Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847615286Z ..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847654157Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/01ca692f-889e-3d4a-9bdd-687e119aec70] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847661889Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062654-7cp0/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/01b7c037-efe7-4965-af20-155c797a2982/test-gpu-standard-2-0-20221203-062700-9b7p-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847669112Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062654-7cp0/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/01b7c037-efe7-4965-af20-155c797a2982/test-gpu-standard-2-0-20221203-062700-9b7p-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847676154Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062654-7cp0/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/01b7c037-efe7-4965-af20-155c797a2982/test-gpu-standard-2-0-20221203-062700-9b7p-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847682821Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847689797Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847700650Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847709289Z Ran 2 tests in 1035.501s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847716151Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847723165Z FAILED (failures=1, skipped=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:44:03.847730148Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.908803605Z FAIL: //gpu:test_gpu (shard 7 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_7_of_15/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926146304Z INFO: From Testing //gpu:test_gpu (shard 7 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926808544Z ==================== Test output for //gpu:test_gpu (shard 7 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926885913Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926899558Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926909164Z [ FAILED ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926916898Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926924280Z FAIL: test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926931591Z test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926940309Z test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926985027Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.926995664Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927004047Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927011407Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927019145Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 135, in test_install_gpu_cuda_nvidia Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927027392Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927035105Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927042833Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927052816Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927061369Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927069098Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927079594Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-055250-jeq8 --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055132-u3ay/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA,cuda-version=11.2 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927087408Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927094150Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927101811Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927109463Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/e416de9e-92d4-3c93-8769-7aef47ade99d]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927119256Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927127514Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927163112Z ..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927188538Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/e416de9e-92d4-3c93-8769-7aef47ade99d] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927197597Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055132-u3ay/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/79efa4ff-9d64-4583-b55f-f144eb50f968/test-gpu-standard-2-0-20221203-055250-jeq8-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927205285Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055132-u3ay/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/79efa4ff-9d64-4583-b55f-f144eb50f968/test-gpu-standard-2-0-20221203-055250-jeq8-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927212639Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055132-u3ay/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/79efa4ff-9d64-4583-b55f-f144eb50f968/test-gpu-standard-2-0-20221203-055250-jeq8-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927220410Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927229702Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927237817Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927246033Z Ran 1 test in 1318.719s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927253359Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927260025Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927267135Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927274265Z ==================== Test output for //gpu:test_gpu (shard 7 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927281607Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927299107Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927307737Z [ FAILED ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927315334Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927322815Z FAIL: test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927330557Z test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927337969Z test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927345454Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927352742Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927362856Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927376118Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927383877Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 135, in test_install_gpu_cuda_nvidia Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927398929Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927406020Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927413847Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927421818Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927429245Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927439318Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927448010Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-061235-pauq --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061222-zpem/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA,cuda-version=11.2 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927455477Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927462649Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927469748Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927476764Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/31dba413-a946-3915-8b61-67acdab2b706]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927483618Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927490463Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927519076Z ..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927533650Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/31dba413-a946-3915-8b61-67acdab2b706] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927540787Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061222-zpem/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7ef2f5b6-a6d0-4134-a932-3721936c354c/test-gpu-standard-2-0-20221203-061235-pauq-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927547795Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061222-zpem/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7ef2f5b6-a6d0-4134-a932-3721936c354c/test-gpu-standard-2-0-20221203-061235-pauq-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927563397Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061222-zpem/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7ef2f5b6-a6d0-4134-a932-3721936c354c/test-gpu-standard-2-0-20221203-061235-pauq-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927577407Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927583961Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.927591464Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933653054Z Ran 1 test in 1021.174s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933677440Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933685989Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933694649Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933702358Z ==================== Test output for //gpu:test_gpu (shard 7 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933710713Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933718953Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933726259Z [ FAILED ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933736296Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933744955Z FAIL: test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933752702Z test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933760909Z test_install_gpu_cuda_nvidia('STANDARD', ['w-0', 'w-1'], None, 'type=nvidia-tesla-v100', '11.2') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933768389Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933789749Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933798755Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933809125Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933818559Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 135, in test_install_gpu_cuda_nvidia Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933826337Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933833841Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933841386Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933863059Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933871114Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933878702Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933889294Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-062918-57qs --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062911-rufu/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA,cuda-version=11.2 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933909052Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933916466Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933924079Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933931920Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/93e2ca7b-5ab5-373e-9bc2-c484817aeae2]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933939084Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.933946698Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934003304Z ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934022755Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/93e2ca7b-5ab5-373e-9bc2-c484817aeae2] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934031044Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062911-rufu/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d96cdc78-da0a-439f-8c9c-7ef8e903b071/test-gpu-standard-2-0-20221203-062918-57qs-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934038474Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062911-rufu/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d96cdc78-da0a-439f-8c9c-7ef8e903b071/test-gpu-standard-2-0-20221203-062918-57qs-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934045793Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062911-rufu/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d96cdc78-da0a-439f-8c9c-7ef8e903b071/test-gpu-standard-2-0-20221203-062918-57qs-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934052677Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934059359Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934066751Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934076580Z Ran 1 test in 966.277s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934084526Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934091861Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:45:09.934099384Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:45:32.353222470Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.837225052Z FAIL: //ranger:test_ranger (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_1_of_3/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.894979243Z INFO: From Testing //ranger:test_ranger (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.900969779Z ==================== Test output for //ranger:test_ranger (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901024946Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901034382Z [ RUN ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901044504Z [ FAILED ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901052891Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901060154Z FAIL: test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901066876Z test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901074646Z test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901132733Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901146673Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901183381Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901193933Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901203498Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901211581Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901218649Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901226259Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901233412Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901241026Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901262041Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901271318Z gcloud dataproc clusters create test-ranger-single-1-5-20221203-063250-364k --single-node --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063219-eu0i/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063219-eu0i/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901301093Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901309174Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901316501Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901324519Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/17d897d8-ba4a-31c6-850b-2a3f95467671]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901331842Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901341771Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901411278Z .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901429487Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/17d897d8-ba4a-31c6-850b-2a3f95467671] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063219-eu0i/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a18c8686-ad67-4f6d-9d3c-d2edef34ab74/test-ranger-single-1-5-20221203-063250-364k-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901439801Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063219-eu0i/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a18c8686-ad67-4f6d-9d3c-d2edef34ab74/test-ranger-single-1-5-20221203-063250-364k-m/dataproc-initialization-script-1_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901448910Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901458263Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901467433Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901475175Z Ran 1 test in 284.211s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901482661Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901525509Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901534288Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901562338Z ==================== Test output for //ranger:test_ranger (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901573116Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901580826Z [ RUN ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901588321Z [ FAILED ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901607446Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901616581Z FAIL: test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901623432Z test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901654684Z test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901693615Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901701986Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901709493Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901716668Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901724514Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901734374Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901743220Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901751066Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901777781Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901786566Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901794231Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901802406Z gcloud dataproc clusters create test-ranger-single-1-5-20221203-063640-gln9 --single-node --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063634-3c1w/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063634-3c1w/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901812918Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901821151Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901828830Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901836746Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b6110286-296e-3f5d-a9a0-92aa30c20b47]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901843740Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.901868959Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.907556880Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908371673Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b6110286-296e-3f5d-a9a0-92aa30c20b47] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063634-3c1w/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a68b5d05-e749-45d4-97df-ff106d020c33/test-ranger-single-1-5-20221203-063640-gln9-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908480861Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063634-3c1w/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a68b5d05-e749-45d4-97df-ff106d020c33/test-ranger-single-1-5-20221203-063640-gln9-m/dataproc-initialization-script-1_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908519015Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908529731Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908537322Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908561504Z Ran 1 test in 249.513s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908570839Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908579336Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908586751Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908614131Z ==================== Test output for //ranger:test_ranger (shard 1 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908624946Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908632578Z [ RUN ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908642642Z [ FAILED ] RangerTestCase.test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908650925Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908658358Z FAIL: test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908665890Z test_ranger('SINGLE', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908672984Z test_ranger('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908741855Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908753139Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908762602Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908770510Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908778855Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908788938Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908813436Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908825840Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908833591Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908841271Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908851238Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908876940Z gcloud dataproc clusters create test-ranger-single-1-5-20221203-064132-l2ay --single-node --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064111-vqoc/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064111-vqoc/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908919650Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908928090Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908937910Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908946791Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/6400df79-7514-3f75-baba-45188bfb4966]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908954933Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908962570Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.908991446Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909002564Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/6400df79-7514-3f75-baba-45188bfb4966] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064111-vqoc/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7cac32ea-9721-4fd3-afaf-d5b2e5d3ec98/test-ranger-single-1-5-20221203-064132-l2ay-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909011708Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064111-vqoc/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7cac32ea-9721-4fd3-afaf-d5b2e5d3ec98/test-ranger-single-1-5-20221203-064132-l2ay-m/dataproc-initialization-script-1_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909018692Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909025344Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909032633Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909040165Z Ran 1 test in 322.399s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909047485Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909071835Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:00.909080543Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:46:09.701397052Z FAIL: //hue:test_hue (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.032955472Z FAIL: //ranger:test_ranger (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_2_of_3/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044766635Z ==================== Test output for //ranger:test_ranger (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044817329Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044836475Z [ RUN ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044844121Z [ FAILED ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044851937Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044859652Z FAIL: test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044867119Z test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044875468Z test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044885535Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044894786Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044905255Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044912557Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044920511Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044927408Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044934280Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044941322Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044950847Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044959729Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044967102Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044975095Z gcloud dataproc clusters create test-ranger-standard-1-5-20221203-063323-3msu --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063252-eefp/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063252-eefp/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044982102Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044988222Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.044994556Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045001596Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/15c05693-d6e8-3fc5-a9a9-6445b4a0acb0]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045010942Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045019397Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045028297Z ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045050958Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/15c05693-d6e8-3fc5-a9a9-6445b4a0acb0] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063252-eefp/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/eb96c1a6-3f90-4ce3-8d2f-c9273bdde367/test-ranger-standard-1-5-20221203-063323-3msu-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045059199Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063252-eefp/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/eb96c1a6-3f90-4ce3-8d2f-c9273bdde367/test-ranger-standard-1-5-20221203-063323-3msu-m/dataproc-initialization-script-1_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045065860Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045072861Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045079937Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045089842Z Ran 1 test in 327.106s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045104048Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045111687Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045118728Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045125927Z ==================== Test output for //ranger:test_ranger (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045133060Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045140005Z [ RUN ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045147300Z [ FAILED ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045157032Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045172340Z FAIL: test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045179512Z test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045186615Z test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045193655Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045200717Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045208067Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045217823Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045226314Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045233359Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045239877Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045246877Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045259496Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045266955Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045273487Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045282862Z gcloud dataproc clusters create test-ranger-standard-1-5-20221203-063746-cdcz --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063740-65f4/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063740-65f4/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045291235Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045298423Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045305095Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045311986Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/888f3b8a-0c64-3364-a989-46e0332b08f1]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045318612Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045325682Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.045353967Z INFO: From Testing //ranger:test_ranger (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055078467Z .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055124679Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/888f3b8a-0c64-3364-a989-46e0332b08f1] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063740-65f4/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ac03cc83-210f-43af-a0ea-7e6ad195d70b/test-ranger-standard-1-5-20221203-063746-cdcz-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055134384Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063740-65f4/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ac03cc83-210f-43af-a0ea-7e6ad195d70b/test-ranger-standard-1-5-20221203-063746-cdcz-m/dataproc-initialization-script-1_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055160195Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055168136Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055175925Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055183666Z Ran 1 test in 220.395s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055190504Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055213002Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055238721Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055247369Z ==================== Test output for //ranger:test_ranger (shard 2 of 3): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055255375Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055262601Z [ RUN ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055272706Z [ FAILED ] RangerTestCase.test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055282650Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055290754Z FAIL: test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055297818Z test_ranger('STANDARD', ['m']) (__main__.RangerTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055304771Z test_ranger('STANDARD', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055330820Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055340842Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055349827Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055356872Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055364662Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/ranger/test_ranger.py", line 42, in test_ranger Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055371333Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055378085Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055384909Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055407421Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/ranger/test_ranger.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055415227Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055422562Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055435749Z gcloud dataproc clusters create test-ranger-standard-1-5-20221203-064158-7pxi --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064145-z40g/solr/solr.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064145-z40g/ranger/ranger.sh' --metadata=ranger-port=6080,default-admin-password=dataproc2019 --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055443285Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055449821Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055464252Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055489961Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/89923a9c-d29f-3a1a-8d48-d73e60567940]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055498606Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055505810Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055514079Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055530101Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/89923a9c-d29f-3a1a-8d48-d73e60567940] failed: Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064145-z40g/solr/solr.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c72dc0ab-031f-4f88-a97e-3673cef484af/test-ranger-standard-1-5-20221203-064158-7pxi-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055539997Z Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064145-z40g/ranger/ranger.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c72dc0ab-031f-4f88-a97e-3673cef484af/test-ranger-standard-1-5-20221203-064158-7pxi-m/dataproc-initialization-script-1_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055547871Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055554492Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055576161Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055583436Z Ran 1 test in 300.678s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055612887Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055623926Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:46:19.055631242Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.687851547Z FAIL: //gpu:test_gpu (shard 5 of 15) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_5_of_15/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708715004Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708770248Z FAILED: //gpu:test_gpu (Summary) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708785193Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_2_of_15/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708794928Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_2_of_15/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708821589Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_2_of_15/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708832049Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_7_of_15/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708841665Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_7_of_15/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708849500Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_7_of_15/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708857253Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_5_of_15/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708864779Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_5_of_15/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708872636Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/gpu/test_gpu/shard_5_of_15/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.708881049Z INFO: From Testing //gpu:test_gpu (shard 5 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.720888293Z ==================== Test output for //gpu:test_gpu (shard 5 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.720944567Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.720977052Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721000508Z [ FAILED ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721009513Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721017271Z FAIL: test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721024018Z test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721057150Z test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721067457Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721076274Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721085887Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721093705Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721102864Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 135, in test_install_gpu_cuda_nvidia Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721110288Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721138235Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721170346Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721178858Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721186588Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721194392Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721222545Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-055510-3dv4 --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055413-npsc/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA,cuda-version=11.0 --master-accelerator=type=nvidia-tesla-v100 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721234625Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721241970Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721249388Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721256440Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/90c7a25b-5d92-3055-8256-9ae45fe23e8c]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721264082Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.721271613Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.729872122Z ..................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.729964032Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/90c7a25b-5d92-3055-8256-9ae45fe23e8c] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.729975328Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055413-npsc/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/fd29e6da-b46c-483f-be57-d643587421e3/test-gpu-standard-2-0-20221203-055510-3dv4-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.729982560Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055413-npsc/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/fd29e6da-b46c-483f-be57-d643587421e3/test-gpu-standard-2-0-20221203-055510-3dv4-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.729989698Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-055413-npsc/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/fd29e6da-b46c-483f-be57-d643587421e3/test-gpu-standard-2-0-20221203-055510-3dv4-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730010243Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730016708Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730023895Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730033444Z Ran 1 test in 1222.586s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730041486Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730048597Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730055018Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730061969Z ==================== Test output for //gpu:test_gpu (shard 5 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730069135Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730077570Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730084329Z [ FAILED ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730093525Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730101673Z FAIL: test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730108705Z test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730116110Z test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730130830Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730138225Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730147055Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730154377Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730173630Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 135, in test_install_gpu_cuda_nvidia Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730182935Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730190542Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730197327Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730203797Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730210557Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730217667Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730225438Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-061404-2r54 --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061346-f3sp/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA,cuda-version=11.0 --master-accelerator=type=nvidia-tesla-v100 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730244465Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730252169Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730259359Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730266322Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/6b749a5c-70fa-3aed-8463-10e3747cf79f]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730273668Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.730280868Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731115182Z .............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731189290Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/6b749a5c-70fa-3aed-8463-10e3747cf79f] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731201320Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061346-f3sp/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/0d841332-a533-4958-88d6-f256965257bc/test-gpu-standard-2-0-20221203-061404-2r54-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731209385Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061346-f3sp/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/0d841332-a533-4958-88d6-f256965257bc/test-gpu-standard-2-0-20221203-061404-2r54-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731216677Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061346-f3sp/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/0d841332-a533-4958-88d6-f256965257bc/test-gpu-standard-2-0-20221203-061404-2r54-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731223073Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731229262Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731236748Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731255867Z Ran 1 test in 1011.804s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731263943Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731271619Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731278712Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731285826Z ==================== Test output for //gpu:test_gpu (shard 5 of 15): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731293014Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731300999Z [ RUN ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731310242Z [ FAILED ] NvidiaGpuDriverTestCase.test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731326505Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731334171Z FAIL: test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731341560Z test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') (__main__.NvidiaGpuDriverTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731348935Z test_install_gpu_cuda_nvidia('STANDARD', ['m', 'w-0', 'w-1'], 'type=nvidia-tesla-v100', 'type=nvidia-tesla-v100', '11.0') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731356247Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731363296Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731371398Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731381019Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731389971Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/gpu/test_gpu.py", line 135, in test_install_gpu_cuda_nvidia Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731397528Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731404668Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731411759Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731424860Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/gpu/test_gpu.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731432237Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731439492Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731449817Z gcloud dataproc clusters create test-gpu-standard-2-0-20221203-063028-3yni --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063021-kd6r/gpu/install_gpu_driver.sh' --initialization-action-timeout=30m --metadata=gpu-driver-provider=NVIDIA,cuda-version=11.0 --master-accelerator=type=nvidia-tesla-v100 --worker-accelerator=type=nvidia-tesla-v100 --master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --master-boot-disk-size=200GB --worker-boot-disk-size=200GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731458739Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731465792Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731473310Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731480642Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/fd4e886d-2dd6-369e-8eae-ecfb1c16ecd2]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731487655Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.731494715Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.734720310Z ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.734880948Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/fd4e886d-2dd6-369e-8eae-ecfb1c16ecd2] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735128007Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063021-kd6r/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e86fb79d-8c69-403b-81f8-9389e987f2dd/test-gpu-standard-2-0-20221203-063028-3yni-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735146139Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063021-kd6r/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e86fb79d-8c69-403b-81f8-9389e987f2dd/test-gpu-standard-2-0-20221203-063028-3yni-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735153754Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063021-kd6r/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e86fb79d-8c69-403b-81f8-9389e987f2dd/test-gpu-standard-2-0-20221203-063028-3yni-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735160045Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735166444Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735174304Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735181589Z Ran 1 test in 985.297s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735210617Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735220313Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:46:38.735228036Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:46:42.240309065Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:47:03.599008517Z FAIL: //hue:test_hue (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:47:04.883162308Z FAIL: //hue:test_hue (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:47:21.920274441Z FAIL: //ranger:test_ranger (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test_attempts/attempt_1.log) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:47:31.790093860Z FAIL: //tony:test_tony (shard 1 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/tony/test_tony/shard_1_of_4/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:47:58.223209286Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T06:49:04+00:00 Step #3 - "dataproc-1.5-rocky8-tests": + grep -q Terminated Step #3 - "dataproc-1.5-rocky8-tests": + kubectl describe pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": ++ date --iso-8601=seconds Step #4 - "dataproc-1.5-ubuntu18-tests": + LOGS_SINCE_TIME=2022-12-03T06:49:04+00:00 Step #4 - "dataproc-1.5-ubuntu18-tests": + grep -q Terminated Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl describe pod/presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #4 - "dataproc-1.5-ubuntu18-tests": + kubectl logs -f presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:49:04+00:00 --timestamps=true Step #3 - "dataproc-1.5-rocky8-tests": + kubectl logs -f presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T06:49:04+00:00 --timestamps=true Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:49:18.596878340Z FAIL: //conda:test_conda (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test_attempts/attempt_1.log) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:23.784620915Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test.log) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:23.857435729Z INFO: From Testing //h2o:test_h2o (shard 1 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167644938Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167725599Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167740127Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167749822Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167759104Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167772874Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167782111Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167790434Z test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167798611Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167807198Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167819014Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167829412Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167838652Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167868024Z self.createCluster(configuration, Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167876947Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167884689Z _, stdout, _ = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167892118Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167899849Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167907104Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167917444Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-063953-nuy4 --num-masters=1 --num-workers=2 --image-version=2.0-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063928-rn5i/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167925738Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167934286Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167942984Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167950783Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/52f745fd-2ea0-3ab4-984e-00259f28cb33]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167957657Z Waiting for cluster creation operation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167965198Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.167989816Z ...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168015338Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/52f745fd-2ea0-3ab4-984e-00259f28cb33] failed: Multiple Errors: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168097452Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063928-rn5i/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/49dcd766-6a17-4dfd-aef9-0916de1579c3/test-h2o-standard-2-0-20221203-063953-nuy4-m/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168181070Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063928-rn5i/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/49dcd766-6a17-4dfd-aef9-0916de1579c3/test-h2o-standard-2-0-20221203-063953-nuy4-w-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168221473Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063928-rn5i/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/49dcd766-6a17-4dfd-aef9-0916de1579c3/test-h2o-standard-2-0-20221203-063953-nuy4-w-1/dataproc-initialization-script-0_output. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168250377Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168258899Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168268374Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168277006Z Ran 1 test in 216.704s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168284490Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168292220Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168300445Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168308742Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168317764Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168326782Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168335472Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168344191Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168353275Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168361774Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168369584Z test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168378126Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168386994Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168396369Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168404798Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168414755Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168423657Z self.createCluster(configuration, Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168432361Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168442019Z _, stdout, _ = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168451183Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168459487Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168467802Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168476905Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-064247-1ms0 --num-masters=1 --num-workers=2 --image-version=2.0-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064240-upbd/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168486626Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168495425Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168504669Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168514523Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/0cda47d3-7456-3384-bcae-90e82086aff1]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168523012Z Waiting for cluster creation operation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168531575Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168550250Z .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168559401Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/0cda47d3-7456-3384-bcae-90e82086aff1] failed: Multiple Errors: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168809752Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064240-upbd/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/65cab9ab-2c82-446b-af90-1692ec6dd345/test-h2o-standard-2-0-20221203-064247-1ms0-m/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168833103Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064240-upbd/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/65cab9ab-2c82-446b-af90-1692ec6dd345/test-h2o-standard-2-0-20221203-064247-1ms0-w-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168879086Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064240-upbd/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/65cab9ab-2c82-446b-af90-1692ec6dd345/test-h2o-standard-2-0-20221203-064247-1ms0-w-1/dataproc-initialization-script-0_output. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168889645Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168898189Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168911742Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168920761Z Ran 1 test in 177.985s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168928599Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168937170Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168945470Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168953890Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168963718Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168973294Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168981994Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168990668Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.168999208Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169007978Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169016507Z test_h2o('STANDARD') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169025254Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169033843Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169044980Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169053762Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169063555Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169084535Z self.createCluster(configuration, Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169094225Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169103622Z _, stdout, _ = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169127353Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169136233Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169162600Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169183592Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-064622-rqa9 --num-masters=1 --num-workers=2 --image-version=2.0-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064555-37km/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169192937Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169215813Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169228522Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169238816Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/d419ce25-77b6-3510-b04a-9eb283786b72]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169248283Z Waiting for cluster creation operation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169257351Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169311796Z .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169326372Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/d419ce25-77b6-3510-b04a-9eb283786b72] failed: Multiple Errors: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169336152Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064555-37km/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b8190eb5-7651-4b91-8b56-98e5dab54e08/test-h2o-standard-2-0-20221203-064622-rqa9-m/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169345109Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064555-37km/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b8190eb5-7651-4b91-8b56-98e5dab54e08/test-h2o-standard-2-0-20221203-064622-rqa9-w-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169353726Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064555-37km/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b8190eb5-7651-4b91-8b56-98e5dab54e08/test-h2o-standard-2-0-20221203-064622-rqa9-w-1/dataproc-initialization-script-0_output. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169372302Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169381066Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169390086Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169398980Z Ran 1 test in 229.322s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169407645Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169415446Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:49:24.169423572Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.853410334Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test.log) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858774385Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858868190Z FAILED: //h2o:test_h2o (Summary) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858883671Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858892951Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_1.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858901670Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_2.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858910453Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858917799Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_1.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.858925149Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_2.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.862813424Z INFO: From Testing //h2o:test_h2o (shard 2 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868699885Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868761049Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868773602Z [ RUN ] H2OTestCase.test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868781533Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868789421Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868797162Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868804709Z test_h2o('HA') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868813290Z test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868821379Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868828599Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868843204Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868851616Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868860430Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868871950Z self.createCluster(configuration, Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868881805Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868911377Z _, stdout, _ = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868921304Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868929145Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868936480Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868947538Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-063957-p3cw --num-masters=3 --num-workers=2 --image-version=2.0-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063933-o8x7/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868955609Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868963318Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868971512Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868980178Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3f16e6b0-8193-3835-b638-b1f29dc71cf1]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868987989Z Waiting for cluster creation operation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.868995664Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869004076Z ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869013969Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3f16e6b0-8193-3835-b638-b1f29dc71cf1] failed: Multiple Errors: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869022602Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063933-o8x7/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/26feef58-413c-4459-863c-959de8e78e30/test-h2o-ha-2-0-20221203-063957-p3cw-m-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869035970Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063933-o8x7/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/26feef58-413c-4459-863c-959de8e78e30/test-h2o-ha-2-0-20221203-063957-p3cw-m-1/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869044023Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063933-o8x7/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/26feef58-413c-4459-863c-959de8e78e30/test-h2o-ha-2-0-20221203-063957-p3cw-m-2/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869051776Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063933-o8x7/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/26feef58-413c-4459-863c-959de8e78e30/test-h2o-ha-2-0-20221203-063957-p3cw-w-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869068192Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063933-o8x7/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/26feef58-413c-4459-863c-959de8e78e30/test-h2o-ha-2-0-20221203-063957-p3cw-w-1/dataproc-initialization-script-0_output. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869075759Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869083122Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869091038Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869098685Z Ran 1 test in 234.876s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869106119Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869113384Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869121033Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869128796Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869136681Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869144166Z [ RUN ] H2OTestCase.test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869153138Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869160329Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869167315Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869174464Z test_h2o('HA') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869182135Z test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869189209Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869220043Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869230722Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869238090Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869245930Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869253313Z self.createCluster(configuration, Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869260812Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869267772Z _, stdout, _ = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869275015Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869282291Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869290019Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869297634Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-064328-0jxg --num-masters=3 --num-workers=2 --image-version=2.0-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064315-lkjr/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869305240Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869320110Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869327791Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869335500Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/44dfa8e1-e416-32a1-98ed-25778de582a6]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869343080Z Waiting for cluster creation operation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.869350445Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872612090Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872657333Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/44dfa8e1-e416-32a1-98ed-25778de582a6] failed: Multiple Errors: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872671405Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064315-lkjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a42ead43-11b7-4eee-9f84-7950771c0c2c/test-h2o-ha-2-0-20221203-064328-0jxg-m-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872680286Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064315-lkjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a42ead43-11b7-4eee-9f84-7950771c0c2c/test-h2o-ha-2-0-20221203-064328-0jxg-m-1/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872689428Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064315-lkjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a42ead43-11b7-4eee-9f84-7950771c0c2c/test-h2o-ha-2-0-20221203-064328-0jxg-m-2/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872697117Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064315-lkjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a42ead43-11b7-4eee-9f84-7950771c0c2c/test-h2o-ha-2-0-20221203-064328-0jxg-w-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872704574Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064315-lkjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a42ead43-11b7-4eee-9f84-7950771c0c2c/test-h2o-ha-2-0-20221203-064328-0jxg-w-1/dataproc-initialization-script-0_output. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872711655Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872718238Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872725902Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872733515Z Ran 1 test in 226.625s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872740315Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872747382Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872754474Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872776889Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872784570Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872792126Z [ RUN ] H2OTestCase.test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872800920Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872808005Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872814928Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872821914Z test_h2o('HA') (__main__.H2OTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872829726Z test_h2o('HA') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872837097Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872844449Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872852620Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872860291Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872867988Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872875303Z self.createCluster(configuration, Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872888551Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872896174Z _, stdout, _ = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872903644Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872911010Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872918378Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872931579Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-064712-fsvj --num-masters=3 --num-workers=2 --image-version=2.0-ubuntu18 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064704-yzmt/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872939097Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872946251Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872953648Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872961541Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/589a8ef9-d464-3501-8858-f21191615c75]. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872969091Z Waiting for cluster creation operation... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872976285Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872984023Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.872999699Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/589a8ef9-d464-3501-8858-f21191615c75] failed: Multiple Errors: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873008580Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064704-yzmt/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/602679cd-2490-4a1f-82d9-08fc7c5e93c0/test-h2o-ha-2-0-20221203-064712-fsvj-m-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873016560Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064704-yzmt/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/602679cd-2490-4a1f-82d9-08fc7c5e93c0/test-h2o-ha-2-0-20221203-064712-fsvj-m-1/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873023567Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064704-yzmt/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/602679cd-2490-4a1f-82d9-08fc7c5e93c0/test-h2o-ha-2-0-20221203-064712-fsvj-m-2/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873030412Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064704-yzmt/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/602679cd-2490-4a1f-82d9-08fc7c5e93c0/test-h2o-ha-2-0-20221203-064712-fsvj-w-0/dataproc-initialization-script-0_output Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873041628Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064704-yzmt/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/602679cd-2490-4a1f-82d9-08fc7c5e93c0/test-h2o-ha-2-0-20221203-064712-fsvj-w-1/dataproc-initialization-script-0_output. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873049579Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873057291Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873065107Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873073405Z Ran 1 test in 207.577s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873081098Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873089216Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:50:11.873097962Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:50:31.528114387Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:50:54.298411150Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_1.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:52:46.119923727Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_2.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.663505665Z FAIL: //bigtable:test_bigtable (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.666403377Z INFO: From Testing //bigtable:test_bigtable (shard 2 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681667331Z ==================== Test output for //bigtable:test_bigtable (shard 2 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681729573Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681740152Z [ RUN ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681768460Z [ FAILED ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681777751Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681785234Z FAIL: test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681792839Z test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681800445Z test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681807288Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681855709Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681865251Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681871711Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681879108Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681886169Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681892289Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681898513Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681907875Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681935789Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681944931Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681952865Z gcloud dataproc clusters create test-bigtable-standard-2-0-20221203-060817-su93 --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060721-nd6q/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-060759-c1t8,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681961076Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681970015Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681978418Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681985558Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3f83e5f8-eb4d-3c99-9ac2-5a058c2c9591]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.681992328Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682026615Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682053867Z ..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682076617Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3f83e5f8-eb4d-3c99-9ac2-5a058c2c9591] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682085423Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060721-nd6q/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7c631ac5-a0d7-4e59-824e-6509cd55abbb/test-bigtable-standard-2-0-20221203-060817-su93-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682165470Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060721-nd6q/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7c631ac5-a0d7-4e59-824e-6509cd55abbb/test-bigtable-standard-2-0-20221203-060817-su93-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682197453Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060721-nd6q/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7c631ac5-a0d7-4e59-824e-6509cd55abbb/test-bigtable-standard-2-0-20221203-060817-su93-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682214351Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.682222127Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683078925Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683105075Z Ran 1 test in 953.502s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683113363Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683120257Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683159221Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683168477Z ==================== Test output for //bigtable:test_bigtable (shard 2 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683176308Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683183611Z [ RUN ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683190203Z [ FAILED ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683199876Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683206623Z FAIL: test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683236170Z test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683246038Z test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683253770Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683261186Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683269106Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683276668Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683287430Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683296173Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683330447Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683337733Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683347369Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683355944Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683363745Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683372093Z gcloud dataproc clusters create test-bigtable-standard-2-0-20221203-062330-nmzb --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062300-s4y8/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-062320-mp07,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683380215Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683414952Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683426280Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683434913Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/24492c36-023b-368e-8046-0f13d85f80f1]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683457910Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683465573Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683552810Z ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683629246Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/24492c36-023b-368e-8046-0f13d85f80f1] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683660853Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062300-s4y8/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c6952dd-cd1f-4337-b6aa-38f2b39f45d2/test-bigtable-standard-2-0-20221203-062330-nmzb-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.683668520Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062300-s4y8/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c6952dd-cd1f-4337-b6aa-38f2b39f45d2/test-bigtable-standard-2-0-20221203-062330-nmzb-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.706841213Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062300-s4y8/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c6952dd-cd1f-4337-b6aa-38f2b39f45d2/test-bigtable-standard-2-0-20221203-062330-nmzb-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.706944266Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.706991899Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707005891Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707015761Z Ran 1 test in 938.492s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707024661Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707034018Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707065558Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707077238Z ==================== Test output for //bigtable:test_bigtable (shard 2 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707088154Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707097893Z [ RUN ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707106611Z [ FAILED ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707114940Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707123371Z FAIL: test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707154338Z test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707166258Z test_bigtable('STANDARD', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707175806Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707185847Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707196492Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707205610Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707245866Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707277624Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707287875Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707297850Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707342267Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707354551Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707364301Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707375329Z gcloud dataproc clusters create test-bigtable-standard-2-0-20221203-063840-5f0x --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063826-2efw/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-063833-lppw,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707385105Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707457050Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707471236Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707481622Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/d682767b-b790-3e93-9d66-5e2424e9e49a]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707491398Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707500958Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707570613Z ............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707637838Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/d682767b-b790-3e93-9d66-5e2424e9e49a] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.707651188Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063826-2efw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ce78173a-572d-402d-89c7-e386ef8d404a/test-bigtable-standard-2-0-20221203-063840-5f0x-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709170160Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063826-2efw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ce78173a-572d-402d-89c7-e386ef8d404a/test-bigtable-standard-2-0-20221203-063840-5f0x-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709339503Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063826-2efw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ce78173a-572d-402d-89c7-e386ef8d404a/test-bigtable-standard-2-0-20221203-063840-5f0x-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709370216Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709381440Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709393394Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709418243Z Ran 1 test in 891.648s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709427523Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709436696Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:53:11.709454988Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.644427061Z FAIL: //horovod:test_horovod (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.657294245Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.657358985Z FAILED: //horovod:test_horovod (Summary) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.657373637Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.657395950Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_1.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.657406145Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_2.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.690826084Z INFO: From Testing //horovod:test_horovod (shard 3 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695070751Z ==================== Test output for //horovod:test_horovod (shard 3 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695110140Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695134315Z [ RUN ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695143035Z [ FAILED ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695150299Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695160174Z FAIL: test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695168672Z test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695180029Z test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695187639Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695194534Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695202755Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695209311Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695216409Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/horovod/test_horovod.py", line 50, in test_horovod_gpu Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695225724Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695233571Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695240215Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695246921Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695253449Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695259923Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695269126Z gcloud dataproc clusters create test-horovod-standard-1-5-20221203-062304-zygc --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062227-9ukq/gpu/install_gpu_driver.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062227-9ukq/horovod/horovod.sh' --initialization-action-timeout=60m --metadata=cuda-version=11.0,cudnn-version=8.0.5.39,gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-p100 --worker-accelerator=type=nvidia-tesla-p100 --master-machine-type=n1-standard-8 --worker-machine-type=n1-standard-8 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695276569Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695286109Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695295235Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695302724Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/7311cd5f-a73a-3370-acd6-5b3190cdcbf8]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695334037Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695342674Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695466304Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695489582Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/7311cd5f-a73a-3370-acd6-5b3190cdcbf8] failed: Multiple Errors: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695499222Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062227-9ukq/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/8c191c3e-8343-423b-8e7e-f147754a434c/test-horovod-standard-1-5-20221203-062304-zygc-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695506670Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062227-9ukq/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/8c191c3e-8343-423b-8e7e-f147754a434c/test-horovod-standard-1-5-20221203-062304-zygc-w-0/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695558037Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062227-9ukq/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/8c191c3e-8343-423b-8e7e-f147754a434c/test-horovod-standard-1-5-20221203-062304-zygc-w-1/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695567146Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695576822Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695585524Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695611756Z Ran 1 test in 675.320s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695621879Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695629254Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695636416Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695643089Z ==================== Test output for //horovod:test_horovod (shard 3 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695668892Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695677013Z [ RUN ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695684714Z [ FAILED ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695716724Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695724499Z FAIL: test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695731319Z test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695741670Z test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695750291Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695758178Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695766334Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695773814Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695816014Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/horovod/test_horovod.py", line 50, in test_horovod_gpu Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695826908Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695835687Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695843585Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695854369Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695862126Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695869133Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695876743Z gcloud dataproc clusters create test-horovod-standard-1-5-20221203-063421-gy3o --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063354-jo3k/gpu/install_gpu_driver.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063354-jo3k/horovod/horovod.sh' --initialization-action-timeout=60m --metadata=cuda-version=11.0,cudnn-version=8.0.5.39,gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-p100 --worker-accelerator=type=nvidia-tesla-p100 --master-machine-type=n1-standard-8 --worker-machine-type=n1-standard-8 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695893839Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695903471Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695912466Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695939344Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f0e2c8a2-3a39-3039-b670-38891bb9dcd1]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695947339Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.695970101Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696019289Z ..........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696031176Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f0e2c8a2-3a39-3039-b670-38891bb9dcd1] failed: Multiple Errors: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696039655Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063354-jo3k/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cdd7020a-2942-45d2-b03f-f2f9e188c7d4/test-horovod-standard-1-5-20221203-063421-gy3o-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696055694Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063354-jo3k/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cdd7020a-2942-45d2-b03f-f2f9e188c7d4/test-horovod-standard-1-5-20221203-063421-gy3o-w-0/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696063186Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063354-jo3k/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cdd7020a-2942-45d2-b03f-f2f9e188c7d4/test-horovod-standard-1-5-20221203-063421-gy3o-w-1/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696070161Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696076739Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696105888Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696115359Z Ran 1 test in 648.767s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696131419Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696155968Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696164899Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696172794Z ==================== Test output for //horovod:test_horovod (shard 3 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696182986Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696191792Z [ RUN ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696199416Z [ FAILED ] HorovodTestCase.test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696206534Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696213666Z FAIL: test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696238611Z test_horovod_gpu('STANDARD', 'gloo') (__main__.HorovodTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696246684Z test_horovod_gpu('STANDARD', 'gloo') Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696257104Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696265726Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696273321Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696280857Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696288783Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/horovod/test_horovod.py", line 50, in test_horovod_gpu Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696313154Z self.createCluster( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696320804Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696330707Z _, stdout, _ = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696339399Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/horovod/test_horovod.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696347297Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696355545Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696860243Z gcloud dataproc clusters create test-horovod-standard-1-5-20221203-064418-r5y1 --num-masters=1 --num-workers=2 --image-version=1.5-debian10 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064411-r3df/gpu/install_gpu_driver.sh,gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064411-r3df/horovod/horovod.sh' --initialization-action-timeout=60m --metadata=cuda-version=11.0,cudnn-version=8.0.5.39,gpu-driver-provider=NVIDIA --master-accelerator=type=nvidia-tesla-p100 --worker-accelerator=type=nvidia-tesla-p100 --master-machine-type=n1-standard-8 --worker-machine-type=n1-standard-8 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696899093Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696907670Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696914616Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696922016Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/ecc28e97-fe7c-3e2f-a13a-b1b3b8407034]. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696928779Z Waiting for cluster creation operation... Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696936539Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696961565Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.696990475Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/ecc28e97-fe7c-3e2f-a13a-b1b3b8407034] failed: Multiple Errors: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697003899Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064411-r3df/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b1ee418e-7259-48a1-90df-62158c125ea9/test-horovod-standard-1-5-20221203-064418-r5y1-m/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697011801Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064411-r3df/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b1ee418e-7259-48a1-90df-62158c125ea9/test-horovod-standard-1-5-20221203-064418-r5y1-w-0/dataproc-initialization-script-0_output Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697019339Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064411-r3df/gpu/install_gpu_driver.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b1ee418e-7259-48a1-90df-62158c125ea9/test-horovod-standard-1-5-20221203-064418-r5y1-w-1/dataproc-initialization-script-0_output. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697025484Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697031869Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697038626Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697048139Z Ran 1 test in 576.186s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697070888Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697079239Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:53:35.697086324Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.850741149Z FAIL: //bigtable:test_bigtable (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.856587263Z INFO: From Testing //bigtable:test_bigtable (shard 1 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864455932Z ==================== Test output for //bigtable:test_bigtable (shard 1 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864535990Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864546957Z [ RUN ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864554353Z [ FAILED ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864561706Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864568299Z FAIL: test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864584598Z test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864607002Z test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864623363Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864631341Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864643016Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864652336Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864660996Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864667884Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864674123Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864680516Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864687410Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864694051Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864700583Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864712182Z gcloud dataproc clusters create test-bigtable-single-2-0-20221203-060813-w17a --single-node --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-slk4/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-060749-ldjj,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864721948Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864729096Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864736669Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864744539Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8f1dd357-f47d-3fed-a695-c400a45c0568]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864752053Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864777214Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864798313Z .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864816406Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8f1dd357-f47d-3fed-a695-c400a45c0568] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-slk4/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/84ecf714-5de6-4625-8259-2667c87ca209/test-bigtable-single-2-0-20221203-060813-w17a-m/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864824488Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864831166Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864838452Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864845573Z Ran 1 test in 1000.804s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864852434Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864859441Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864866711Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864876063Z ==================== Test output for //bigtable:test_bigtable (shard 1 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864884523Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864891661Z [ RUN ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864908441Z [ FAILED ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864915936Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864922628Z FAIL: test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.864929278Z test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894531447Z test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894584165Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894608524Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894627974Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894637681Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894647559Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894655771Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894663341Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894669937Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894676447Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894684161Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894691258Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894722455Z gcloud dataproc clusters create test-bigtable-single-2-0-20221203-062414-7a9g --single-node --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-gxds/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-062404-kquq,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894730671Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894737041Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894744426Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894751591Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/bef091dc-6add-3249-aa44-3e0191e94f18]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894757943Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894764774Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894785888Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894805153Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/bef091dc-6add-3249-aa44-3e0191e94f18] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-gxds/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/7ef40285-88a2-479b-a855-6514e603cc7e/test-bigtable-single-2-0-20221203-062414-7a9g-m/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894813293Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894820258Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894827465Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894834837Z Ran 1 test in 939.859s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894842118Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894849103Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894856568Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894866431Z ==================== Test output for //bigtable:test_bigtable (shard 1 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894875330Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894882776Z [ RUN ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894890353Z [ FAILED ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894897727Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894904594Z FAIL: test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894911774Z test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894918840Z test_bigtable('SINGLE', ['m']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894928340Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894937080Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894945360Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.894953213Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.899893065Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.899971670Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.899983627Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.899994612Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900002792Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900009886Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900016686Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900023849Z gcloud dataproc clusters create test-bigtable-single-2-0-20221203-063939-hr3q --single-node --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063917-i3lb/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-063927-32u9,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900050018Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900057805Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900064723Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900071878Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/db747410-79e9-346c-bf59-92c64c34ac47]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900079015Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900086228Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900142144Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900164531Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/db747410-79e9-346c-bf59-92c64c34ac47] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063917-i3lb/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/ce31267d-2e99-4e6b-a3eb-0825fb1daf85/test-bigtable-single-2-0-20221203-063939-hr3q-m/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900172651Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900182157Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900191015Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900221133Z Ran 1 test in 916.716s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900228443Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900238421Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:24.900247321Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:54:45.752704518Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_2.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:55:09.389425107Z FAIL: //horovod:test_horovod (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:55:13.211319234Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:55:39.745496164Z FAIL: //bigtable:test_bigtable (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:56:10.327869153Z FAIL: //bigtable:test_bigtable (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T06:56:11.499147985Z FAIL: //bigtable:test_bigtable (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.531655462Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.534367409Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.534439331Z FAILED: //sqoop:test_sqoop (Summary) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.534451960Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.534469612Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_1.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.534479275Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_2.log Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.539295319Z INFO: From Testing //sqoop:test_sqoop (shard 4 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596884235Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596930339Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596957744Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596968167Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596976184Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596983244Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596990234Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.596997671Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597053354Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597063902Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597078438Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597085369Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597093791Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597138664Z self.import_mysql_db(instance) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597148646Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597158174Z self.assert_instance_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597167036Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597175504Z ret_code, stdout, stderr = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597183458Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597191210Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597214769Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597226751Z gcloud compute ssh test-sqoop-single-1-5-20221203-064400-ndwh-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597236209Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597243693Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597251416Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597258258Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597265370Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597271528Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597277681Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597303172Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597311182Z Ran 1 test in 277.643s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597317883Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597324568Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597331733Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597341043Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597349329Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597356073Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597378238Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597385372Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597392016Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597401431Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597409186Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597416262Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597432067Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597439061Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597460893Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597470534Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597478631Z self.import_mysql_db(instance) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597502351Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597509180Z self.assert_instance_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597515901Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597522571Z ret_code, stdout, stderr = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597552396Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597560453Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597567390Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597574663Z gcloud compute ssh test-sqoop-single-1-5-20221203-064903-yscb-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597581401Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597590290Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597626825Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597633894Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597640730Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597647158Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597656049Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597666999Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597674287Z Ran 1 test in 285.713s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597681159Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597703256Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597710286Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597719771Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597727685Z Running tests under Python 3.8.10: /usr/bin/python3 Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597734978Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597741576Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597748236Z ====================================================================== Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597754956Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597761889Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597783598Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597790973Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597798020Z Traceback (most recent call last): Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597813042Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597820054Z test_method(self, *testcase_params) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597826883Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597834184Z self.import_mysql_db(instance) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597843584Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597866457Z self.assert_instance_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597874023Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597880818Z ret_code, stdout, stderr = self.assert_command( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597887502Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597894414Z self.assertEqual( Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597903998Z AssertionError: 1 != 0 : Failed to execute command: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597911992Z gcloud compute ssh test-sqoop-single-1-5-20221203-065308-frn0-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597919011Z STDOUT: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597925591Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597932325Z STDERR: Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597957521Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597965574Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597972177Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597978493Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597985338Z ---------------------------------------------------------------------- Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597991916Z Ran 1 test in 207.332s Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.597998481Z Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.598005207Z FAILED (failures=1) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T06:56:14.598014594Z ================================================================================ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.776867620Z INFO: From Testing //tony:test_tony (shard 1 of 4): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782737706Z ==================== Test output for //tony:test_tony (shard 1 of 4): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782793369Z Running tests under Python 3.8.10: /usr/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782808055Z [ RUN ] TonYTestCase.test_tony_tf('SINGLE') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782817091Z [ FAILED ] TonYTestCase.test_tony_tf('SINGLE') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782825676Z ====================================================================== Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782834218Z FAIL: test_tony_tf('SINGLE') (__main__.TonYTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782842413Z test_tony_tf('SINGLE') (__main__.TonYTestCase) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782851515Z test_tony_tf('SINGLE') Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782860221Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782867294Z Traceback (most recent call last): Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782877812Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/tony/test_tony.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782902977Z test_method(self, testcase_params) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782912110Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/tony/test_tony.runfiles/__main__/tony/test_tony.py", line 30, in test_tony_tf Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782918973Z self.assert_dataproc_job( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782926079Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/tony/test_tony.runfiles/__main__/integration_tests/dataproc_test_case.py", line 298, in assert_dataproc_job Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782933297Z ret_code, stdout, stderr = self.assert_command( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782940063Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/tony/test_tony.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782946725Z self.assertEqual( Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782954178Z AssertionError: 1 != 0 : Failed to execute command: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782963953Z gcloud dataproc jobs submit hadoop --cluster=test-tony-single-2-0-20221203-063728-vb1u --region=us-central1 --class=com.linkedin.tony.cli.ClusterSubmitter --jars=file:///opt/tony/TonY-samples/tony-cli.jar -- --src_dir=/opt/tony/TonY-samples/jobs/TFJob/src --task_params="--data_dir /tmp --working_dir /tmp" --conf_file=/opt/tony/TonY-samples/jobs/TFJob/tony.xml --executes=mnist_keras_distributed.py --python_venv=/opt/tony/TonY-samples/deps/tf.zip --python_binary_path=tf/bin/python3 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782972199Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782989511Z STDOUT: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.782996633Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783004215Z STDERR: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783011679Z Job [3fe031ad8d4e4b18ae8fabb2e5749198] submitted. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783019122Z Waiting for job output... Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783028379Z /usr/lib/hadoop/libexec//hadoop-functions.sh: line 2400: HADOOP_COM.GOOGLE.CLOUD.HADOOP.SERVICES.AGENT.JOB.SHIM.HADOOPRUNCLASSSHIM_USER: bad substitution Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783035929Z /usr/lib/hadoop/libexec//hadoop-functions.sh: line 2365: HADOOP_COM.GOOGLE.CLOUD.HADOOP.SERVICES.AGENT.JOB.SHIM.HADOOPRUNCLASSSHIM_USER: bad substitution Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783042886Z /usr/lib/hadoop/libexec//hadoop-functions.sh: line 2460: HADOOP_COM.GOOGLE.CLOUD.HADOOP.SERVICES.AGENT.JOB.SHIM.HADOOPRUNCLASSSHIM_OPTS: bad substitution Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783050237Z SLF4J: Class path contains multiple SLF4J bindings. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783058317Z SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-reload4j-1.7.35.jar!/org/slf4j/impl/StaticLoggerBinder.class] Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783065666Z SLF4J: Found binding in [jar:file:/opt/tony/TonY-samples/tony-cli-0.4.0-uber.jar!/org/slf4j/impl/StaticLoggerBinder.class] Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783072743Z SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783080078Z SLF4J: Actual binding is of type [org.slf4j.impl.Reload4jLoggerFactory] Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783087274Z 2022-12-03 06:45:36,049 INFO cli.ClusterSubmitter: Starting ClusterSubmitter.. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783111986Z 2022-12-03 06:45:36,138 INFO cli.ClusterSubmitter: Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, 3fe031ad8d4e4b18ae8fabb2e5749198-conf.xml, hdfs-default.xml, hdfs-site.xml, resource-types.xml, /etc/hadoop/conf/core-site.xml, /etc/hadoop/conf/hdfs-site.xml Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783129372Z 2022-12-03 06:45:38,603 INFO cli.ClusterSubmitter: Copying /opt/tony/TonY-samples/tony-cli-0.4.0-uber.jar to: hdfs://test-tony-single-2-0-20221203-063728-vb1u-m/user/root/.tony/7e9d1868-f0ee-4a6b-84b7-201def942521 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783137270Z 2022-12-03 06:45:38,635 INFO tony.TonyClient: TonY heartbeat interval [1000] Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783145905Z 2022-12-03 06:45:38,635 INFO tony.TonyClient: TonY max heartbeat misses allowed [25] Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783159726Z 2022-12-03 06:45:38,875 INFO tony.TonyClient: Starting client.. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783168400Z 2022-12-03 06:45:38,880 INFO client.RMProxy: Connecting to ResourceManager at test-tony-single-2-0-20221203-063728-vb1u-m/10.128.0.138:8032 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783176359Z 2022-12-03 06:45:39,135 INFO client.AHSProxy: Connecting to Application History server at test-tony-single-2-0-20221203-063728-vb1u-m/10.128.0.138:10200 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783184781Z 2022-12-03 06:45:39,250 INFO conf.Configuration: resource-types.xml not found Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783192989Z 2022-12-03 06:45:39,251 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783217905Z 2022-12-03 06:45:42,139 INFO tony.TonyClient: Completed setting up Application Master command {{JAVA_HOME}}/bin/java -Xmx1638m -Dyarn.app.container.log.dir= com.linkedin.tony.ApplicationMaster 1>/amstdout.log 2>/amstderr.log Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783228827Z 2022-12-03 06:45:42,140 INFO tony.TonyClient: Submitting YARN application Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783237713Z 2022-12-03 06:45:42,585 INFO impl.YarnClientImpl: Submitted application application_1670049574324_0001 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783246678Z 2022-12-03 06:45:42,588 INFO tony.TonyClient: URL to track running application (will proxy to TensorBoard once it has started): http://test-tony-single-2-0-20221203-063728-vb1u-m:8088/proxy/application_1670049574324_0001/ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783256440Z 2022-12-03 06:45:42,588 INFO tony.TonyClient: ResourceManager web address for application: http://test-tony-single-2-0-20221203-063728-vb1u-m:8088/cluster/app/application_1670049574324_0001 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783264401Z 2022-12-03 06:45:51,881 INFO tony.TonyClient: Driver (application master) log url: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000001/root Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783272002Z 2022-12-03 06:45:51,881 INFO tony.TonyClient: AM host: test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783279269Z 2022-12-03 06:45:51,881 INFO tony.TonyClient: AM RPC port: 35965 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783287860Z 2022-12-03 06:45:55,005 INFO tony.TonyClient: Task status updated: [TaskInfo] name: worker, index: 1, url: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000003/yarn status: RUNNING Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783295254Z 2022-12-03 06:45:55,005 INFO tony.TonyClient: Task status updated: [TaskInfo] name: worker, index: 0, url: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000002/yarn status: RUNNING Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783302476Z 2022-12-03 06:45:55,007 INFO tony.TonyClient: Logs for worker 0 at: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000002/yarn Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783309573Z 2022-12-03 06:45:55,007 INFO tony.TonyClient: Logs for worker 1 at: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000003/yarn Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783316764Z 2022-12-03 06:46:25,171 INFO tony.TonyClient: Task status updated: [TaskInfo] name: worker, index: 1, url: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000003/yarn status: FAILED Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783332625Z 2022-12-03 06:47:25,402 INFO tony.TonyClient: Task status updated: [TaskInfo] name: worker, index: 0, url: http://test-tony-single-2-0-20221203-063728-vb1u-m.c.cloud-dataproc-ci.internal:8042/node/containerlogs/container_1670049574324_0001_01_000002/yarn status: FAILED Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783340403Z 2022-12-03 06:47:26,406 INFO tony.TonyClient: Application 1 finished with YarnState=FINISHED, DSFinalStatus=FAILED, breaking monitoring loop. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783349169Z 2022-12-03 06:47:26,406 INFO tony.TonyClient: Link for application_1670049574324_0001's events/metrics: https://localhost:19886/jobs/application_1670049574324_0001 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783356660Z 2022-12-03 06:47:26,412 INFO tony.TonyClient: Sent message to AM to stop. Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783364076Z 2022-12-03 06:47:26,412 ERROR tony.TonyClient: Application failed to complete successfully Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783371974Z 2022-12-03 06:47:26,470 INFO impl.YarnClientImpl: Killed application application_1670049574324_0001 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783379509Z ERROR: (gcloud.dataproc.jobs.submit.hadoop) Job [3fe031ad8d4e4b18ae8fabb2e5749198] failed with error: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.783386952Z Google Cloud Dataproc Agent reports job failure. If logs are available, they can be found at: Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789307260Z https://console.cloud.google.com/dataproc/jobs/3fe031ad8d4e4b18ae8fabb2e5749198?project=cloud-dataproc-ci®ion=us-central1 Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789391840Z gcloud dataproc jobs wait '3fe031ad8d4e4b18ae8fabb2e5749198' --region 'us-central1' --project 'cloud-dataproc-ci' Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789409401Z https://console.cloud.google.com/storage/browser/dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/9249a9a8-ae84-49a7-90d7-be6d0c6a07dd/jobs/3fe031ad8d4e4b18ae8fabb2e5749198/ Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789419346Z gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/9249a9a8-ae84-49a7-90d7-be6d0c6a07dd/jobs/3fe031ad8d4e4b18ae8fabb2e5749198/driveroutput Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789426386Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789433541Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789460982Z ---------------------------------------------------------------------- Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789470012Z Ran 1 test in 764.862s Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789477585Z Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789485103Z FAILED (failures=1) Step #7 - "dataproc-2.0-ubuntu18-tests": 2022-12-03T06:57:04.789493051Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T06:57:17.501786755Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.087440629Z FAIL: //h2o:test_h2o (shard 1 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.087535377Z INFO: From Testing //h2o:test_h2o (shard 1 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125847339Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125909156Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125920758Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125928034Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125937109Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125945826Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125953069Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125961320Z test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125968441Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125975209Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125983171Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.125997198Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126007040Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126015544Z self.createCluster(configuration, Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126022263Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126028590Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126035231Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126041706Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126048267Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126058036Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-064631-fy8q --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064624-zrjr/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126067833Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126075766Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126083644Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126092267Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/14141905-cd7d-324c-b68b-dcd78d994749]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126099284Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126107031Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126117094Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126153558Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/14141905-cd7d-324c-b68b-dcd78d994749] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126173413Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064624-zrjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/34550cf1-ba00-4017-a249-2656d08f6f9c/test-h2o-standard-2-0-20221203-064631-fy8q-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126183150Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064624-zrjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/34550cf1-ba00-4017-a249-2656d08f6f9c/test-h2o-standard-2-0-20221203-064631-fy8q-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126191329Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064624-zrjr/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/34550cf1-ba00-4017-a249-2656d08f6f9c/test-h2o-standard-2-0-20221203-064631-fy8q-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126198528Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126205236Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126212563Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126220188Z Ran 1 test in 255.221s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126227566Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126237311Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126245721Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126253636Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126261696Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126269228Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126276800Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126284419Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126291758Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126301676Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126310022Z test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126318094Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126325809Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126337774Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126387137Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126397096Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126431346Z self.createCluster(configuration, Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126440327Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126448841Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126471949Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126480941Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126488340Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126498656Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-065047-mabc --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065040-cb26/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126507350Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126515299Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126522955Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126567329Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/9d0caf90-f00b-3b05-8ab2-533288a7f85d]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126574934Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126633871Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126694831Z .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126705387Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/9d0caf90-f00b-3b05-8ab2-533288a7f85d] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126713476Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065040-cb26/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/736fbeb0-72f6-4c0f-b042-ae30a109f524/test-h2o-standard-2-0-20221203-065047-mabc-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126721368Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065040-cb26/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/736fbeb0-72f6-4c0f-b042-ae30a109f524/test-h2o-standard-2-0-20221203-065047-mabc-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126736961Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065040-cb26/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/736fbeb0-72f6-4c0f-b042-ae30a109f524/test-h2o-standard-2-0-20221203-065047-mabc-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126746591Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126755019Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126766259Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126774827Z Ran 1 test in 253.509s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126782334Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126789425Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126796339Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126816686Z ==================== Test output for //h2o:test_h2o (shard 1 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126825926Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126833935Z [ RUN ] H2OTestCase.test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126841314Z [ FAILED ] H2OTestCase.test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126848964Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126855873Z FAIL: test_h2o('STANDARD') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126863336Z test_h2o('STANDARD') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126873071Z test_h2o('STANDARD') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126882206Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126890133Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126898026Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126905914Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126913676Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126921654Z self.createCluster(configuration, Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126928670Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126938513Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126952387Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126960714Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.126986731Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127003983Z gcloud dataproc clusters create test-h2o-standard-2-0-20221203-065500-lkfr --num-masters=1 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065453-zxcz/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127011745Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127021379Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127044213Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127052614Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3ea4f798-40ce-379b-8822-d4661b840646]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127060076Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127068140Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127076390Z ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127084094Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3ea4f798-40ce-379b-8822-d4661b840646] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127091556Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065453-zxcz/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b3df8af4-169c-4a87-abac-5b7bb5f3d180/test-h2o-standard-2-0-20221203-065500-lkfr-m/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127101760Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065453-zxcz/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b3df8af4-169c-4a87-abac-5b7bb5f3d180/test-h2o-standard-2-0-20221203-065500-lkfr-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127110911Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065453-zxcz/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b3df8af4-169c-4a87-abac-5b7bb5f3d180/test-h2o-standard-2-0-20221203-065500-lkfr-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127118696Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127125853Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127133619Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127140707Z Ran 1 test in 273.515s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127147664Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127155284Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:20.127165760Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.712460070Z FAIL: //:test_cloud_sql_proxy (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.728401187Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.728492664Z FAILED: //:test_cloud_sql_proxy (Summary) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.728522079Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.728530889Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.728538376Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.735504754Z INFO: From Testing //:test_cloud_sql_proxy (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751696154Z ==================== Test output for //:test_cloud_sql_proxy (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751778871Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751791445Z [ RUN ] CloudSqlProxyTestCase.test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751799262Z [ FAILED ] CloudSqlProxyTestCase.test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751806591Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751813799Z FAIL: test_cloud_sql_proxy('HA') (__main__.CloudSqlProxyTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751823496Z test_cloud_sql_proxy('HA') (__main__.CloudSqlProxyTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751832017Z test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751839321Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751846863Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751857022Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751864599Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751872198Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/cloud-sql-proxy/test_cloud_sql_proxy.py", line 61, in test_cloud_sql_proxy Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751879234Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751888832Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751896626Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751903627Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751911010Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751918257Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751927118Z gcloud dataproc clusters create test-cloud-sql-proxy-ha-2-0-20221203-060727-6223 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060313-31um/cloud-sql-proxy/cloud-sql-proxy.sh' --metadata=hive-metastore-instance=cloud-dataproc-ci:us-central1:test-cloud-sql-20221203-060408-mok7,hive-metastore-db=metastore --scopes=sql-admin --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751934914Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751941453Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751951302Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751960009Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/5fd29d2b-bbaf-382c-bab2-d321af67b73f]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751983600Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.751991107Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752022425Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752038972Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/5fd29d2b-bbaf-382c-bab2-d321af67b73f] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752050125Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060313-31um/cloud-sql-proxy/cloud-sql-proxy.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/855132a8-6a4c-474e-ad60-4b6566a115b8/test-cloud-sql-proxy-ha-2-0-20221203-060727-6223-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752068305Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060313-31um/cloud-sql-proxy/cloud-sql-proxy.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/855132a8-6a4c-474e-ad60-4b6566a115b8/test-cloud-sql-proxy-ha-2-0-20221203-060727-6223-m-2/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752075629Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752082238Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752088902Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752095993Z Ran 1 test in 1218.595s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752102637Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.752112032Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761802082Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761881501Z ==================== Test output for //:test_cloud_sql_proxy (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761893716Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761901289Z [ RUN ] CloudSqlProxyTestCase.test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761908519Z [ FAILED ] CloudSqlProxyTestCase.test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761915126Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761922291Z FAIL: test_cloud_sql_proxy('HA') (__main__.CloudSqlProxyTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761931962Z test_cloud_sql_proxy('HA') (__main__.CloudSqlProxyTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761940824Z test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761948049Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761955998Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761965742Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761973012Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761980696Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/cloud-sql-proxy/test_cloud_sql_proxy.py", line 61, in test_cloud_sql_proxy Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761987583Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.761997576Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762021819Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762029136Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762036046Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762043282Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762071797Z gcloud dataproc clusters create test-cloud-sql-proxy-ha-2-0-20221203-062614-gnr1 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062242-14bj/cloud-sql-proxy/cloud-sql-proxy.sh' --metadata=hive-metastore-instance=cloud-dataproc-ci:us-central1:test-cloud-sql-20221203-062255-yw4d,hive-metastore-db=metastore --scopes=sql-admin --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762080524Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762089979Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762098282Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762106111Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8ed2d188-c428-3ad9-a9f4-3d5f5b5cd741]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762113233Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762120420Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762150612Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762169451Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8ed2d188-c428-3ad9-a9f4-3d5f5b5cd741] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762179135Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062242-14bj/cloud-sql-proxy/cloud-sql-proxy.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d455d870-6991-4827-97f0-f1e626a3a570/test-cloud-sql-proxy-ha-2-0-20221203-062614-gnr1-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762186370Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062242-14bj/cloud-sql-proxy/cloud-sql-proxy.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d455d870-6991-4827-97f0-f1e626a3a570/test-cloud-sql-proxy-ha-2-0-20221203-062614-gnr1-m-2/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762193235Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762199986Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762207127Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762214041Z Ran 1 test in 1096.334s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762220849Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762230378Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.762238532Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792750283Z ==================== Test output for //:test_cloud_sql_proxy (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792816662Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792829492Z [ RUN ] CloudSqlProxyTestCase.test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792837775Z [ FAILED ] CloudSqlProxyTestCase.test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792860340Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792867040Z FAIL: test_cloud_sql_proxy('HA') (__main__.CloudSqlProxyTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792874062Z test_cloud_sql_proxy('HA') (__main__.CloudSqlProxyTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792882811Z test_cloud_sql_proxy('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792889600Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792897007Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792906840Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792915295Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792922542Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/cloud-sql-proxy/test_cloud_sql_proxy.py", line 61, in test_cloud_sql_proxy Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792929187Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792935849Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792942553Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792948824Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/test_cloud_sql_proxy.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792955497Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792964675Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792973144Z gcloud dataproc clusters create test-cloud-sql-proxy-ha-2-0-20221203-064458-46x6 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064120-4mbf/cloud-sql-proxy/cloud-sql-proxy.sh' --metadata=hive-metastore-instance=cloud-dataproc-ci:us-central1:test-cloud-sql-20221203-064139-xz11,hive-metastore-db=metastore --scopes=sql-admin --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792980852Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792986964Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.792993358Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793000313Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/05b79dd9-b726-373e-b2c9-315d782bff46]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793006605Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793013280Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793038259Z ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793057258Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/05b79dd9-b726-373e-b2c9-315d782bff46] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064120-4mbf/cloud-sql-proxy/cloud-sql-proxy.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/202fa766-2ed9-412f-80e4-fddfd21c4f2d/test-cloud-sql-proxy-ha-2-0-20221203-064458-46x6-m-2/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793068862Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793075192Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793081667Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793088300Z Ran 1 test in 1132.915s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793095115Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793101549Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:37.793111140Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.390729111Z FAIL: //h2o:test_h2o (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.393912563Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.393957232Z FAILED: //h2o:test_h2o (Summary) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.393969730Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.393992576Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.394271423Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_1_of_2/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.394281076Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.394288704Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.394295829Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/h2o/test_h2o/shard_2_of_2/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.402241926Z INFO: From Testing //h2o:test_h2o (shard 2 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410048602Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410100895Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410111614Z [ RUN ] H2OTestCase.test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410128399Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410138592Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410147207Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410522979Z test_h2o('HA') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410543319Z test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410552014Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.410559379Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411348925Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411393945Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411403548Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411411405Z self.createCluster(configuration, Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411418012Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411442242Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411451565Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411459959Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411467110Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411476514Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-064654-q267 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064647-kd1f/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411483610Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411490171Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411497593Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411504394Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f808cf19-ebed-347a-820f-0ab028c068b1]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411513396Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411521578Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411530990Z ...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411538327Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/f808cf19-ebed-347a-820f-0ab028c068b1] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411554108Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064647-kd1f/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d03eac59-37ff-4be7-9ed0-903572a7e9e2/test-h2o-ha-2-0-20221203-064654-q267-m-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411560870Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064647-kd1f/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d03eac59-37ff-4be7-9ed0-903572a7e9e2/test-h2o-ha-2-0-20221203-064654-q267-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411567440Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064647-kd1f/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d03eac59-37ff-4be7-9ed0-903572a7e9e2/test-h2o-ha-2-0-20221203-064654-q267-m-2/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411583373Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064647-kd1f/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d03eac59-37ff-4be7-9ed0-903572a7e9e2/test-h2o-ha-2-0-20221203-064654-q267-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411608507Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064647-kd1f/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d03eac59-37ff-4be7-9ed0-903572a7e9e2/test-h2o-ha-2-0-20221203-064654-q267-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411618759Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411625633Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411633293Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411640078Z Ran 1 test in 254.859s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411646413Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411655139Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411663266Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411670208Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411676809Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411683719Z [ RUN ] H2OTestCase.test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411689858Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411695940Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411702173Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411711125Z test_h2o('HA') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411719688Z test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411726755Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411733163Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411739655Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411746213Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411752972Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411759607Z self.createCluster(configuration, Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411768587Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411776715Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411783290Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411789805Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411796255Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411803048Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-065109-6qix --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065103-qi77/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411819525Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411826073Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411835164Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411860690Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/e6811108-6327-3640-ba3b-2ecf54fd4929]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411867819Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411874588Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411883608Z ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411890319Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/e6811108-6327-3640-ba3b-2ecf54fd4929] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411897272Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065103-qi77/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e7b60918-1c88-47d5-abb4-5cca19dfb50b/test-h2o-ha-2-0-20221203-065109-6qix-m-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411906149Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065103-qi77/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e7b60918-1c88-47d5-abb4-5cca19dfb50b/test-h2o-ha-2-0-20221203-065109-6qix-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411914293Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065103-qi77/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e7b60918-1c88-47d5-abb4-5cca19dfb50b/test-h2o-ha-2-0-20221203-065109-6qix-m-2/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411921163Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065103-qi77/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e7b60918-1c88-47d5-abb4-5cca19dfb50b/test-h2o-ha-2-0-20221203-065109-6qix-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411927963Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065103-qi77/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e7b60918-1c88-47d5-abb4-5cca19dfb50b/test-h2o-ha-2-0-20221203-065109-6qix-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411942069Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411948207Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411954932Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411961410Z Ran 1 test in 258.034s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411970028Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411978012Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411984690Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411991370Z ==================== Test output for //h2o:test_h2o (shard 2 of 2): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.411998120Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412004872Z [ RUN ] H2OTestCase.test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412011424Z [ FAILED ] H2OTestCase.test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412017875Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412026698Z FAIL: test_h2o('HA') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412034750Z test_h2o('HA') (__main__.H2OTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412041825Z test_h2o('HA') Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412048365Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412054676Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412061037Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/io_abseil_py/absl/testing/parameterized.py", line 267, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412067648Z test_method(self, testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412078252Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/h2o/test_h2o.py", line 21, in test_h2o Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412087593Z self.createCluster(configuration, Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412095431Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412102121Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412109179Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/h2o/test_h2o.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412125552Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412132496Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412139144Z gcloud dataproc clusters create test-h2o-ha-2-0-20221203-065531-3ol3 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065524-1qbp/h2o/h2o.sh' --scopes=cloud-platform --master-machine-type=e2-highmem-4 --worker-machine-type=e2-highmem-4 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412145643Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412154165Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412162166Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412168835Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/bc1b0bba-9756-39c5-b24c-72d3dec5842b]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412175368Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412181830Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412197717Z ...............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412204675Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/bc1b0bba-9756-39c5-b24c-72d3dec5842b] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412211238Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065524-1qbp/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a09fcd8c-9b00-4af8-b2c4-e39d47afcfa4/test-h2o-ha-2-0-20221203-065531-3ol3-m-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412220383Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065524-1qbp/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a09fcd8c-9b00-4af8-b2c4-e39d47afcfa4/test-h2o-ha-2-0-20221203-065531-3ol3-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412228560Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065524-1qbp/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a09fcd8c-9b00-4af8-b2c4-e39d47afcfa4/test-h2o-ha-2-0-20221203-065531-3ol3-m-2/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412242693Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065524-1qbp/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a09fcd8c-9b00-4af8-b2c4-e39d47afcfa4/test-h2o-ha-2-0-20221203-065531-3ol3-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412249587Z - Initialization action failed. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065524-1qbp/h2o/h2o.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/a09fcd8c-9b00-4af8-b2c4-e39d47afcfa4/test-h2o-ha-2-0-20221203-065531-3ol3-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412255551Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412261784Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412268355Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412277363Z Ran 1 test in 266.265s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412284959Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412291639Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T06:59:41.412298506Z ================================================================================ Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T07:02:29.052433308Z FAIL: //ranger:test_ranger (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/ranger/test_ranger/shard_3_of_3/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.187085837Z FAIL: //hue:test_hue (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.218030191Z INFO: From Testing //hue:test_hue (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327060519Z ==================== Test output for //hue:test_hue (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327136904Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327151969Z [ RUN ] HueTestCase.test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327160417Z [ FAILED ] HueTestCase.test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327168803Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327176419Z FAIL: test_hue('STANDARD', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327184227Z test_hue('STANDARD', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327192629Z test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327201911Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327210510Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327219086Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327227153Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327242619Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327249811Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327257815Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327265311Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327272391Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327279387Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327286584Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327297825Z gcloud dataproc clusters create test-hue-standard-1-5-20221203-061309-6crv --num-masters=1 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061140-cqsx/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327305571Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327312635Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327320278Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327328575Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8001d99a-ac9b-345e-a2e3-8bb99302fe8c]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327336245Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327344875Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327368674Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327415164Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/8001d99a-ac9b-345e-a2e3-8bb99302fe8c] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061140-cqsx/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/d6c4f553-7242-48d4-b91e-050e2774f58a/test-hue-standard-1-5-20221203-061309-6crv-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327423682Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327431212Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327439250Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327447834Z Ran 1 test in 1119.469s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327454989Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327462715Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327470775Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327479039Z ==================== Test output for //hue:test_hue (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327487333Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327495255Z [ RUN ] HueTestCase.test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327502996Z [ FAILED ] HueTestCase.test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327510836Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327518801Z FAIL: test_hue('STANDARD', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327527093Z test_hue('STANDARD', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327535175Z test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327543182Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327550997Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327559177Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.327982862Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328029674Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328047335Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328057435Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328065056Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328072532Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328080338Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328087404Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328099743Z gcloud dataproc clusters create test-hue-standard-1-5-20221203-063059-pq89 --num-masters=1 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063004-7906/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328127575Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328135852Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328144026Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328153852Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/dc02860a-f715-3d3f-9740-c42bad34ef5c]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328174008Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328184729Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328220318Z ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328239570Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/dc02860a-f715-3d3f-9740-c42bad34ef5c] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063004-7906/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/709df66f-483b-491a-ad92-bdeb27ca585a/test-hue-standard-1-5-20221203-063059-pq89-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328247787Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328256024Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328266187Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328274833Z Ran 1 test in 1063.165s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328281810Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328288800Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328296471Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328303398Z ==================== Test output for //hue:test_hue (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328310412Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328318703Z [ RUN ] HueTestCase.test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328327099Z [ FAILED ] HueTestCase.test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328334981Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328342837Z FAIL: test_hue('STANDARD', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328350221Z test_hue('STANDARD', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328357498Z test_hue('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328365366Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328373145Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328381151Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328388241Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328396745Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328404000Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328411288Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328418952Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.328427556Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329510089Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329570661Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329613257Z gcloud dataproc clusters create test-hue-standard-1-5-20221203-064826-xp9d --num-masters=1 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064735-wlss/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329622115Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329629705Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329648360Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329657777Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/e534924b-59d6-365d-b860-d184065af58a]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329666032Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329674926Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329715802Z ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329736452Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/e534924b-59d6-365d-b860-d184065af58a] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064735-wlss/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/1c6876c9-4f06-4efe-89aa-46d08f8be73d/test-hue-standard-1-5-20221203-064826-xp9d-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329745030Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329752858Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329761219Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329769596Z Ran 1 test in 1013.921s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329777540Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329785641Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:03:09.329794145Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:03:20.602274929Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_2.log) Step #2 - "dataproc-1.5-debian10-tests": 2022-12-03T07:03:22.702275458Z FAIL: //conda:test_conda (shard 2 of 2) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/conda/test_conda/shard_2_of_2/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.120023030Z FAIL: //hue:test_hue (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.127099929Z INFO: From Testing //hue:test_hue (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133192578Z ==================== Test output for //hue:test_hue (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133242781Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133254715Z [ RUN ] HueTestCase.test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133263033Z [ FAILED ] HueTestCase.test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133270987Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133279001Z FAIL: test_hue('HA', ['m-0']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133286954Z test_hue('HA', ['m-0']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133296065Z test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133304212Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133312246Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133323002Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133330658Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133338649Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133361664Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133368877Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133375607Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133382906Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133389849Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133397212Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133408015Z gcloud dataproc clusters create test-hue-ha-1-5-20221203-061322-csie --num-masters=3 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061155-cjzf/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133416281Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133423472Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133431024Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133439163Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/9411cfa0-e4c9-3b7e-908b-7879688d5e33]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133446523Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133455755Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133477015Z .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133494752Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/9411cfa0-e4c9-3b7e-908b-7879688d5e33] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061155-cjzf/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/fd183c7e-9152-41a6-a4d1-fdd02fc39bc6/test-hue-ha-1-5-20221203-061322-csie-m-0/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133501878Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133508950Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133516290Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133523687Z Ran 1 test in 1135.826s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133530638Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133546850Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133554245Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133561661Z ==================== Test output for //hue:test_hue (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133569062Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133576019Z [ RUN ] HueTestCase.test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133583037Z [ FAILED ] HueTestCase.test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133590021Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133598067Z FAIL: test_hue('HA', ['m-0']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133605669Z test_hue('HA', ['m-0']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133612987Z test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133619886Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133633909Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133642744Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133650846Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133659326Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133667324Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133674856Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133683727Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133692903Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133700336Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133707781Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133714748Z gcloud dataproc clusters create test-hue-ha-1-5-20221203-063135-irip --num-masters=3 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063032-8ke9/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133722278Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133729236Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133737223Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133744589Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/ce56d6c5-b5cd-3005-ad7a-3e40b5e3d848]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133751743Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133758771Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133785519Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133802186Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/ce56d6c5-b5cd-3005-ad7a-3e40b5e3d848] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063032-8ke9/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/68dee823-9a8e-44c8-96e6-dc2d8051fc72/test-hue-ha-1-5-20221203-063135-irip-m-0/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133809421Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133816773Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133823772Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133831221Z Ran 1 test in 1091.047s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133838309Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133845401Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133852844Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133860353Z ==================== Test output for //hue:test_hue (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133873990Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133881495Z [ RUN ] HueTestCase.test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133888886Z [ FAILED ] HueTestCase.test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133896203Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133918137Z FAIL: test_hue('HA', ['m-0']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133928026Z test_hue('HA', ['m-0']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133935542Z test_hue('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133942949Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133950066Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133957346Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133964748Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133972424Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133979699Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133987189Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.133994227Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134001383Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134008652Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134016826Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134024273Z gcloud dataproc clusters create test-hue-ha-1-5-20221203-064927-berf --num-masters=3 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064842-cp5p/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134031652Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134038479Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134046490Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134054173Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1f39287f-52c2-3a62-8e2f-dcf09ed58a0f]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134061597Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134068769Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134083666Z ....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134098969Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/1f39287f-52c2-3a62-8e2f-dcf09ed58a0f] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064842-cp5p/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/0c885bc0-f0c8-4af3-9722-6b5878c923ab/test-hue-ha-1-5-20221203-064927-berf-m-0/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134111995Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134119045Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134126111Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134133235Z Ran 1 test in 1034.056s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134140001Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134146909Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:25.134153903Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.233966347Z FAIL: //hue:test_hue (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.241868100Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.241963443Z FAILED: //hue:test_hue (Summary) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.241980246Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.241989845Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test_attempts/attempt_1.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.241997297Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test_attempts/attempt_2.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.242004343Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.242011580Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test_attempts/attempt_1.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.242019551Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test_attempts/attempt_2.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.242036260Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.242043779Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test_attempts/attempt_1.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.242051146Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test_attempts/attempt_2.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.252999609Z INFO: From Testing //hue:test_hue (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282519343Z ==================== Test output for //hue:test_hue (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282595394Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282605481Z [ RUN ] HueTestCase.test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282613043Z [ FAILED ] HueTestCase.test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282620331Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282636515Z FAIL: test_hue('SINGLE', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282660756Z test_hue('SINGLE', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282668888Z test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282676014Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282683269Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282694342Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282721300Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282745568Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282753445Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282779614Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282787204Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282794920Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282802614Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282826471Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282836806Z gcloud dataproc clusters create test-hue-single-1-5-20221203-061313-hzn8 --single-node --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061136-vo14/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282844820Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282852219Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282859947Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282868128Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/506739b2-baed-338f-b0e0-cac3a8e0ab2d]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282876342Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282884633Z ...WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282935307Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282961377Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/506739b2-baed-338f-b0e0-cac3a8e0ab2d] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061136-vo14/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/fbf9d63e-0361-4a2f-b577-9f651b6b849c/test-hue-single-1-5-20221203-061313-hzn8-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282970126Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282976446Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.282983537Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283009764Z Ran 1 test in 1151.581s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283017061Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283024580Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283031943Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283038817Z ==================== Test output for //hue:test_hue (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283045847Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283053083Z [ RUN ] HueTestCase.test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283060333Z [ FAILED ] HueTestCase.test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283090468Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283099232Z FAIL: test_hue('SINGLE', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283106782Z test_hue('SINGLE', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283114242Z test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283121820Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.283129229Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.288940436Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.288985876Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289015711Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289024181Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289031589Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289038656Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289045388Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289052632Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289059450Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289069128Z gcloud dataproc clusters create test-hue-single-1-5-20221203-063140-qgke --single-node --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063036-ofbq/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289076992Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289101273Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289108639Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289116742Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b28567b4-f3f8-3ac1-9d91-d834e606d320]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289124115Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289131305Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289152607Z ........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289208648Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b28567b4-f3f8-3ac1-9d91-d834e606d320] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063036-ofbq/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/4c9e803b-741f-45ed-a016-0b6a859d6fd0/test-hue-single-1-5-20221203-063140-qgke-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289215923Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289222846Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289230772Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289295484Z Ran 1 test in 1086.541s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289303783Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289310660Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289327101Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289334244Z ==================== Test output for //hue:test_hue (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289341377Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289348432Z [ RUN ] HueTestCase.test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289355690Z [ FAILED ] HueTestCase.test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289383321Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289391738Z FAIL: test_hue('SINGLE', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289399655Z test_hue('SINGLE', ['m']) (__main__.HueTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289409246Z test_hue('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289417767Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289424837Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289432217Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289439606Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289463891Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/hue/test_hue.py", line 31, in test_hue Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289472314Z self.createCluster(configuration, self.INIT_ACTIONS) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289479967Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.289487017Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.295935153Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/hue/test_hue.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.295975761Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.295985565Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.295993584Z gcloud dataproc clusters create test-hue-single-1-5-20221203-064930-56nf --single-node --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064843-lbbo/hue/hue.sh' --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296017972Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296024728Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296031837Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296039422Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/843af955-a6a6-324a-b001-b7bf584f1fad]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296048587Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296059362Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296096919Z ...........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296125935Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/843af955-a6a6-324a-b001-b7bf584f1fad] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-064843-lbbo/hue/hue.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/e7b60652-e31d-4bba-8e6b-f41d2e645276/test-hue-single-1-5-20221203-064930-56nf-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296133354Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296140291Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296148187Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296155343Z Ran 1 test in 1041.508s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296178973Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296186753Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:04:31.296194220Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:06:18.663308772Z FAIL: //tony:test_tony (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/tony/test_tony/shard_4_of_4/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:06:32.518928869Z FAIL: //tony:test_tony (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/tony/test_tony/shard_3_of_4/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:08:00.976480728Z FAIL: //horovod:test_horovod (shard 3 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/horovod/test_horovod/shard_3_of_4/test_attempts/attempt_2.log) Step #3 - "dataproc-1.5-rocky8-tests": ++ date --iso-8601=seconds Step #3 - "dataproc-1.5-rocky8-tests": + LOGS_SINCE_TIME=2022-12-03T07:08:26+00:00 Step #3 - "dataproc-1.5-rocky8-tests": + grep -q Terminated Step #3 - "dataproc-1.5-rocky8-tests": + kubectl describe pod/presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": + kubectl logs -f presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 --since-time=2022-12-03T07:08:26+00:00 --timestamps=true Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:08:31.113105656Z FAIL: //hue:test_hue (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_1_of_3/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:09:02.682803366Z FAIL: //:test_cloud_sql_proxy (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/test_cloud_sql_proxy/shard_3_of_3/test_attempts/attempt_1.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:09:13.369495163Z FAIL: //hue:test_hue (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_2_of_3/test_attempts/attempt_1.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.107275535Z FAIL: //sqoop:test_sqoop (shard 4 of 4) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test.log) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.111509818Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.111552266Z FAILED: //sqoop:test_sqoop (Summary) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.111566112Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.111577461Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_1.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.111593427Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/sqoop/test_sqoop/shard_4_of_4/test_attempts/attempt_2.log Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.115152899Z INFO: From Testing //sqoop:test_sqoop (shard 4 of 4): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117666773Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117753014Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117804077Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117813771Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117821303Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117829204Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117836252Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117856362Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117863627Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117871486Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117883091Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117890827Z test_method(self, *testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117924765Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117936164Z self.import_mysql_db(instance) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117944773Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117952940Z self.assert_instance_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117961201Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117969203Z ret_code, stdout, stderr = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117977703Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.117986826Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118012019Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118023448Z gcloud compute ssh test-sqoop-single-2-0-20221203-065239-ju1g-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118032143Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118039120Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118047623Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118055686Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118064132Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118071739Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118095954Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118113640Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118121840Z Ran 1 test in 341.974s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118130057Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118138043Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118156557Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118182049Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118190960Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118199058Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118207019Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118215037Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118225848Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118234063Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118241864Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118271714Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118280519Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118288879Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118296595Z test_method(self, *testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118304972Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118312744Z self.import_mysql_db(instance) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118359983Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118370846Z self.assert_instance_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118379057Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118386990Z ret_code, stdout, stderr = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118394938Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118402994Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118410611Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118438965Z gcloud compute ssh test-sqoop-single-2-0-20221203-065824-ss7a-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118448394Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118455570Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118463447Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118471445Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118479571Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118487366Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118495095Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118520187Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118528851Z Ran 1 test in 357.489s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118536631Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118544354Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118552262Z ================================================================================ Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118570123Z ==================== Test output for //sqoop:test_sqoop (shard 4 of 4): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118577996Z Running tests under Python 3.8.10: /usr/bin/python3 Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118603586Z [ RUN ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118613089Z [ FAILED ] SqoopTestCase.test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118621032Z ====================================================================== Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118629216Z FAIL: test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118637126Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) (__main__.SqoopTestCase) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118645374Z test_sqoop_import_from_local_mysql_to_hdfs('SINGLE', ['m']) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118652692Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118660526Z Traceback (most recent call last): Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118668417Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118695497Z test_method(self, *testcase_params) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118703559Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 64, in test_sqoop_import_from_local_mysql_to_hdfs Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118711095Z self.import_mysql_db(instance) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118719294Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/sqoop/test_sqoop.py", line 37, in import_mysql_db Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118727257Z self.assert_instance_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118735526Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 270, in assert_instance_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118743257Z ret_code, stdout, stderr = self.assert_command( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118750983Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/sqoop/test_sqoop.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118777979Z self.assertEqual( Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118786555Z AssertionError: 1 != 0 : Failed to execute command: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118794653Z gcloud compute ssh test-sqoop-single-2-0-20221203-070612-n0iv-m --zone=us-central1-f --command="zcat test_sql_db_dump.gz | mysql -u root -proot-password" Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118802670Z STDOUT: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118809905Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118817860Z STDERR: Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118826071Z mysql: [Warning] Using a password on the command line interface can be insecure. Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118834051Z ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118855900Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118864443Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118872822Z ---------------------------------------------------------------------- Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118880992Z Ran 1 test in 386.530s Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118888784Z Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118896584Z FAILED (failures=1) Step #5 - "dataproc-2.0-debian10-tests": 2022-12-03T07:09:53.118927256Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:10:43.655712698Z FAIL: //hue:test_hue (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/hue/test_hue/shard_3_of_3/test_attempts/attempt_1.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.449291782Z FAIL: //bigtable:test_bigtable (shard 2 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.474244803Z INFO: From Testing //bigtable:test_bigtable (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478550164Z ==================== Test output for //bigtable:test_bigtable (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478601475Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478629574Z [ RUN ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478655915Z [ FAILED ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478669529Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478676548Z FAIL: test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478684200Z test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478724138Z test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478732344Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478740498Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478748779Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478756098Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478764143Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478771728Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478803381Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478811566Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478818739Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478826167Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478853187Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478878280Z gcloud dataproc clusters create test-bigtable-standard-1-5-20221203-062121-q659 --num-masters=1 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061939-3v94/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-062051-ud6p,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478886822Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478893761Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478922157Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478933630Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/a66eb7c7-edee-3ee5-b648-ce928302eaab]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478940645Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478948716Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.478983419Z .............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.479029196Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/a66eb7c7-edee-3ee5-b648-ce928302eaab] failed: Multiple Errors: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.479037600Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061939-3v94/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/28a13e70-dfc7-4b61-8fbd-d08d0f7c578a/test-bigtable-standard-1-5-20221203-062121-q659-m/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.479045436Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061939-3v94/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/28a13e70-dfc7-4b61-8fbd-d08d0f7c578a/test-bigtable-standard-1-5-20221203-062121-q659-w-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.483866648Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061939-3v94/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/28a13e70-dfc7-4b61-8fbd-d08d0f7c578a/test-bigtable-standard-1-5-20221203-062121-q659-w-1/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.483961736Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.483973238Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.483982331Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.483990645Z Ran 1 test in 1141.697s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.483997502Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484020744Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484028262Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484035654Z ==================== Test output for //bigtable:test_bigtable (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484043541Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484050906Z [ RUN ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484058101Z [ FAILED ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484065339Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484072825Z FAIL: test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484118380Z test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484128213Z test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484140426Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484150402Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484158752Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484165824Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484177428Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484209360Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484219865Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484228290Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484236110Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484243560Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484251099Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484259093Z gcloud dataproc clusters create test-bigtable-standard-1-5-20221203-064032-l8iv --num-masters=1 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063852-fyra/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-063949-c9ij,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484267463Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484290981Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484298456Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484306450Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/da5357b3-4d80-3438-9e96-67b1ec272a14]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484314352Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484322369Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484384664Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484405572Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/da5357b3-4d80-3438-9e96-67b1ec272a14] failed: Multiple Errors: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.484416439Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063852-fyra/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cd2e7d77-628c-4743-8eef-a4152798f558/test-bigtable-standard-1-5-20221203-064032-l8iv-m/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488225866Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063852-fyra/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/cd2e7d77-628c-4743-8eef-a4152798f558/test-bigtable-standard-1-5-20221203-064032-l8iv-w-1/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488331257Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488343161Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488353435Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488361970Z Ran 1 test in 1103.845s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488386757Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488394083Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488401256Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488408331Z ==================== Test output for //bigtable:test_bigtable (shard 2 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488416556Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488424466Z [ RUN ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488431627Z [ FAILED ] BigTableTestCase.test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488438638Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488446080Z FAIL: test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488469629Z test_bigtable('STANDARD', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488477907Z test_bigtable('STANDARD', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488485104Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488493212Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488507349Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488514802Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488526415Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488534172Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488558572Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488566907Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488575026Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488582988Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488591288Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488601873Z gcloud dataproc clusters create test-bigtable-standard-1-5-20221203-065644-xwmf --num-masters=1 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065600-75y4/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-065626-cl26,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488609889Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488616824Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488639898Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488656952Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/78bb0bd9-92b5-38bf-8be2-c1da26914602]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488675223Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488683044Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488741285Z ......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488759375Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/78bb0bd9-92b5-38bf-8be2-c1da26914602] failed: Multiple Errors: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488767398Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065600-75y4/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b2dc652d-b559-440f-9471-c10da111c284/test-bigtable-standard-1-5-20221203-065644-xwmf-m/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.488775006Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065600-75y4/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b2dc652d-b559-440f-9471-c10da111c284/test-bigtable-standard-1-5-20221203-065644-xwmf-w-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491214794Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065600-75y4/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/b2dc652d-b559-440f-9471-c10da111c284/test-bigtable-standard-1-5-20221203-065644-xwmf-w-1/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491272466Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491281782Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491290043Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491297970Z Ran 1 test in 945.002s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491304386Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491311367Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:11:25.491320120Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.767979304Z FAIL: //bigtable:test_bigtable (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.775426774Z INFO: From Testing //bigtable:test_bigtable (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801114400Z ==================== Test output for //bigtable:test_bigtable (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801177783Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801192393Z [ RUN ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801203755Z [ FAILED ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801216462Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801226101Z FAIL: test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801233777Z test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801242866Z test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801256004Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801265553Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801278552Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801315200Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801325045Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801333374Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801341197Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801347960Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801355676Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801363457Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801374518Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801389203Z gcloud dataproc clusters create test-bigtable-ha-1-5-20221203-062127-iiu2 --num-masters=3 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061946-e3gw/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-062057-g5ym,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801399909Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801407327Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801415032Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801423429Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b4c6dd9a-ec3e-3f2a-a940-a9725d45bcf8]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801431117Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801439064Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801465852Z ...................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801492374Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/b4c6dd9a-ec3e-3f2a-a940-a9725d45bcf8] failed: Multiple Errors: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801503400Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061946-e3gw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c56b119c-23ac-48eb-8582-170e17b82f1c/test-bigtable-ha-1-5-20221203-062127-iiu2-m-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.801511649Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061946-e3gw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c56b119c-23ac-48eb-8582-170e17b82f1c/test-bigtable-ha-1-5-20221203-062127-iiu2-m-2/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.808880367Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061946-e3gw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c56b119c-23ac-48eb-8582-170e17b82f1c/test-bigtable-ha-1-5-20221203-062127-iiu2-w-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.808970346Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061946-e3gw/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c56b119c-23ac-48eb-8582-170e17b82f1c/test-bigtable-ha-1-5-20221203-062127-iiu2-w-1/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.808983573Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.808991503Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.808999997Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809008503Z Ran 1 test in 1149.439s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809019266Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809032976Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809043418Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809051194Z ==================== Test output for //bigtable:test_bigtable (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809059523Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809066953Z [ RUN ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809074655Z [ FAILED ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809082325Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809089942Z FAIL: test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809098105Z test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809109360Z test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809123081Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809134359Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809143696Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809151402Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809159532Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809167213Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809175099Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809182810Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809190993Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809203029Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809213591Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809226924Z gcloud dataproc clusters create test-bigtable-ha-1-5-20221203-064042-6x4d --num-masters=3 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063910-fn0i/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-064010-b6it,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809244368Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809251453Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809258864Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809267920Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/31e0c685-c162-3fd0-93e9-81bd8a692ff8]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809275717Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809283013Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809313119Z .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809333648Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/31e0c685-c162-3fd0-93e9-81bd8a692ff8] failed: Multiple Errors: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.809342430Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063910-fn0i/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c8b5196d-02ef-4c8d-9910-0f263cb7bca9/test-bigtable-ha-1-5-20221203-064042-6x4d-m-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814077511Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063910-fn0i/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c8b5196d-02ef-4c8d-9910-0f263cb7bca9/test-bigtable-ha-1-5-20221203-064042-6x4d-m-1/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814124238Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063910-fn0i/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c8b5196d-02ef-4c8d-9910-0f263cb7bca9/test-bigtable-ha-1-5-20221203-064042-6x4d-m-2/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814139420Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063910-fn0i/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c8b5196d-02ef-4c8d-9910-0f263cb7bca9/test-bigtable-ha-1-5-20221203-064042-6x4d-w-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814153535Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063910-fn0i/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c8b5196d-02ef-4c8d-9910-0f263cb7bca9/test-bigtable-ha-1-5-20221203-064042-6x4d-w-1/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814162788Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814170599Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814179384Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814187984Z Ran 1 test in 1119.694s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814194744Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814202870Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814211011Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814219429Z ==================== Test output for //bigtable:test_bigtable (shard 3 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814235861Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814246598Z [ RUN ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814255139Z [ FAILED ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814280586Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814288612Z FAIL: test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814296661Z test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814304781Z test_bigtable('HA', ['m-0']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814316354Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814330786Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814341226Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814349306Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814358080Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814366118Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814373924Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814381792Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814393231Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814404941Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814418815Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814431634Z gcloud dataproc clusters create test-bigtable-ha-1-5-20221203-065725-kdos --num-masters=3 --num-workers=2 --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065652-pr2v/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-065713-bxwv,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814440067Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814447634Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814455835Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814464435Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/d3129544-fd77-3f68-af94-04fcb48d7622]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814478055Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.814486764Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887334450Z ..............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887427491Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/d3129544-fd77-3f68-af94-04fcb48d7622] failed: Multiple Errors: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887440320Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065652-pr2v/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6912c868-f973-46b0-a8c5-b257d0da875c/test-bigtable-ha-1-5-20221203-065725-kdos-m-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887457776Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065652-pr2v/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6912c868-f973-46b0-a8c5-b257d0da875c/test-bigtable-ha-1-5-20221203-065725-kdos-m-1/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887465390Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065652-pr2v/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6912c868-f973-46b0-a8c5-b257d0da875c/test-bigtable-ha-1-5-20221203-065725-kdos-m-2/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887523130Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065652-pr2v/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6912c868-f973-46b0-a8c5-b257d0da875c/test-bigtable-ha-1-5-20221203-065725-kdos-w-0/dataproc-initialization-script-0_output Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887534007Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065652-pr2v/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/6912c868-f973-46b0-a8c5-b257d0da875c/test-bigtable-ha-1-5-20221203-065725-kdos-w-1/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887542002Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887550396Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887580132Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887589978Z Ran 1 test in 954.219s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887597883Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887604475Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:08.887612246Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.613796895Z FAIL: //bigtable:test_bigtable (shard 1 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test.log) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617331252Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617385670Z FAILED: //bigtable:test_bigtable (Summary) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617400071Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617417879Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_1.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617426208Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_2.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617435422Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617444172Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_1.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617452787Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_2.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617460760Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617484788Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_1.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.617491803Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_2.log Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.620625578Z INFO: From Testing //bigtable:test_bigtable (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.623900918Z ==================== Test output for //bigtable:test_bigtable (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.623962518Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.623976226Z [ RUN ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.623985342Z [ FAILED ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.623994807Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624003641Z FAIL: test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624011984Z test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624020035Z test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624027542Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624036393Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624045741Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624053521Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624061372Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624068627Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624075787Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624082521Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624090035Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624097654Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624105757Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624117387Z gcloud dataproc clusters create test-bigtable-single-1-5-20221203-062114-moj8 --single-node --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061934-6pde/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-062040-5huq,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624125652Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624132549Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624139416Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624146798Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3a6aae31-1b76-30a7-8a4b-be8f6295e035]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624154309Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624172835Z ..WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624195014Z ................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624212612Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/3a6aae31-1b76-30a7-8a4b-be8f6295e035] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-061934-6pde/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/f98aff2f-c1ac-4997-969c-eca2efbee801/test-bigtable-single-1-5-20221203-062114-moj8-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624219942Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624227120Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624234713Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624242467Z Ran 1 test in 1159.889s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624249541Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624256959Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624264520Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624272344Z ==================== Test output for //bigtable:test_bigtable (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624280755Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624288802Z [ RUN ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624295963Z [ FAILED ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624303322Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624310701Z FAIL: test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624317918Z test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624334691Z test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624342470Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624350124Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624357950Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624366006Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624374058Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624381345Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624388535Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624395759Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624403078Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624410573Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624424361Z AssertionError: -9 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624432030Z gcloud dataproc clusters create test-bigtable-single-1-5-20221203-064045-k1ow --single-node --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063912-a0mf/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-064011-2lmn,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624439601Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624447346Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624455648Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624463311Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/c3f15ef3-a28c-3de8-99b6-f26a9ef932dc]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624470564Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624477889Z .WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624515604Z .....................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624532109Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/c3f15ef3-a28c-3de8-99b6-f26a9ef932dc] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063912-a0mf/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/37c9fdfb-4e35-45c6-9e32-7c934e9dd7c4/test-bigtable-single-1-5-20221203-064045-k1ow-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624540404Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624547634Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624555585Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624563817Z Ran 1 test in 1116.850s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624571475Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624579003Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624587112Z ================================================================================ Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624609227Z ==================== Test output for //bigtable:test_bigtable (shard 1 of 3): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624618101Z Running tests under Python 3.8.10: /usr/bin/python3 Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624626530Z [ RUN ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624635699Z [ FAILED ] BigTableTestCase.test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624643257Z ====================================================================== Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624650704Z FAIL: test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624657735Z test_bigtable('SINGLE', ['m']) (__main__.BigTableTestCase) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624665024Z test_bigtable('SINGLE', ['m']) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624672256Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624679360Z Traceback (most recent call last): Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624686729Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.624694456Z test_method(self, *testcase_params) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.626947055Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.626988231Z self.createCluster( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.626997499Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627006737Z _, stdout, _ = self.assert_command( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627015638Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627023666Z self.assertEqual( Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627031180Z AssertionError: 1 != 0 : Failed to execute command: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627038934Z gcloud dataproc clusters create test-bigtable-single-1-5-20221203-065725-vfs4 --single-node --image-version=1.5-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065653-rijr/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-065713-4wdh,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627046086Z STDOUT: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627052894Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627059906Z STDERR: Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627067403Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/4d34bb2a-780c-39a3-94e9-d15792f65c7c]. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627074394Z Waiting for cluster creation operation... Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627081421Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627120218Z .........................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627142469Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/4d34bb2a-780c-39a3-94e9-d15792f65c7c] failed: Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-065653-rijr/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/f508ae8b-b364-4dd7-b637-7c10ff7153aa/test-bigtable-single-1-5-20221203-065725-vfs4-m/dataproc-initialization-script-0_output. Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627149897Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627157031Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627164683Z ---------------------------------------------------------------------- Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627172126Z Ran 1 test in 960.357s Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627179372Z Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627187547Z FAILED (failures=1) Step #3 - "dataproc-1.5-rocky8-tests": 2022-12-03T07:12:13.627195322Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.762370887Z FAIL: //bigtable:test_bigtable (shard 3 of 3) (see /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test.log) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796005900Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796114907Z FAILED: //bigtable:test_bigtable (Summary) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796131451Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796140944Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796148627Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_2_of_3/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796172291Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796181969Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796197210Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_1_of_3/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796204596Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796211843Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_1.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.796218869Z /home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/testlogs/bigtable/test_bigtable/shard_3_of_3/test_attempts/attempt_2.log Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.799905097Z ==================== Test output for //bigtable:test_bigtable (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.799995620Z INFO: From Testing //bigtable:test_bigtable (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.799955580Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800036575Z [ RUN ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800062762Z [ FAILED ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800087580Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800094320Z FAIL: test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800100920Z test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800107855Z test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800114180Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800123918Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800157675Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800166433Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800174955Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800184584Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800196224Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800204145Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800211815Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800237373Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800280587Z AssertionError: 1 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800321918Z gcloud dataproc clusters create test-bigtable-ha-2-0-20221203-060819-v8ud --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-fkdq/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-060801-9ywg,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800330629Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800340175Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800349278Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800357756Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/0fb9e696-fe59-3acb-98d1-c723853da429]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800364963Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800372102Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800432557Z .......................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800462853Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/0fb9e696-fe59-3acb-98d1-c723853da429] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800493864Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-fkdq/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c51a6dd9-7208-4e6f-ae11-31a885ef23ec/test-bigtable-ha-2-0-20221203-060819-v8ud-m-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800512003Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-fkdq/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c51a6dd9-7208-4e6f-ae11-31a885ef23ec/test-bigtable-ha-2-0-20221203-060819-v8ud-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800519620Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-fkdq/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c51a6dd9-7208-4e6f-ae11-31a885ef23ec/test-bigtable-ha-2-0-20221203-060819-v8ud-m-2/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800526735Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-060722-fkdq/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/c51a6dd9-7208-4e6f-ae11-31a885ef23ec/test-bigtable-ha-2-0-20221203-060819-v8ud-w-0/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800533449Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800539760Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800546521Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800553073Z Ran 1 test in 996.093s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800910415Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800944761Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800952718Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800959765Z ==================== Test output for //bigtable:test_bigtable (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800966976Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800974480Z [ RUN ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.800992204Z [ FAILED ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801015685Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801023436Z FAIL: test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801030316Z test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801037045Z test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801044130Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801053846Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801064885Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801072215Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801095835Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801103408Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801113123Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801121355Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801128293Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801146480Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801153628Z AssertionError: -9 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801191086Z gcloud dataproc clusters create test-bigtable-ha-2-0-20221203-062414-ouc0 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-7gmy/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-062403-wf16,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801199830Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801206782Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801213918Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801221057Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/c47c3100-f0e0-3bcb-ac14-f20adee2a293]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801228110Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801258373Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801281543Z .............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801298065Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/c47c3100-f0e0-3bcb-ac14-f20adee2a293] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801308144Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-7gmy/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/4ee89958-c31f-46bc-a7b7-e35617b908f2/test-bigtable-ha-2-0-20221203-062414-ouc0-m-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801316276Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-7gmy/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/4ee89958-c31f-46bc-a7b7-e35617b908f2/test-bigtable-ha-2-0-20221203-062414-ouc0-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801343458Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-7gmy/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/4ee89958-c31f-46bc-a7b7-e35617b908f2/test-bigtable-ha-2-0-20221203-062414-ouc0-m-2/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801351530Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-7gmy/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/4ee89958-c31f-46bc-a7b7-e35617b908f2/test-bigtable-ha-2-0-20221203-062414-ouc0-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801358447Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-062348-7gmy/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/4ee89958-c31f-46bc-a7b7-e35617b908f2/test-bigtable-ha-2-0-20221203-062414-ouc0-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801373785Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801382182Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801389831Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801397023Z Ran 1 test in 967.857s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801403697Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801429101Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801438890Z ================================================================================ Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801446305Z ==================== Test output for //bigtable:test_bigtable (shard 3 of 3): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801453405Z Running tests under Python 3.8.10: /usr/bin/python3 Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801460298Z [ RUN ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801467246Z [ FAILED ] BigTableTestCase.test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801474313Z ====================================================================== Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801490361Z FAIL: test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801520580Z test_bigtable('HA', ['m-0']) (__main__.BigTableTestCase) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801528585Z test_bigtable('HA', ['m-0']) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801535505Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801542015Z Traceback (most recent call last): Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801551353Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/io_abseil_py/absl/testing/parameterized.py", line 265, in bound_param_test Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801559541Z test_method(self, *testcase_params) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801567258Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/bigtable/test_bigtable.py", line 71, in test_bigtable Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801588791Z self.createCluster( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801607335Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 170, in createCluster Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801616231Z _, stdout, _ = self.assert_command( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801631265Z File "/home/ia-tests/.cache/bazel/_bazel_ia-tests/83b1ae36bb04ea5432b9efccee83c25f/execroot/__main__/bazel-out/k8-fastbuild/bin/bigtable/test_bigtable.runfiles/__main__/integration_tests/dataproc_test_case.py", line 322, in assert_command Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801638755Z self.assertEqual( Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801645787Z AssertionError: -9 != 0 : Failed to execute command: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801653362Z gcloud dataproc clusters create test-bigtable-ha-2-0-20221203-064014-3mu7 --num-masters=3 --num-workers=2 --image-version=2.0-rocky8 --initialization-actions='gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063953-ejio/bigtable/bigtable.sh' --metadata=bigtable-instance=test-bt-20221203-064006-l7jx,bigtable-project=cloud-dataproc-ci --master-machine-type=e2-standard-2 --worker-machine-type=e2-standard-2 --master-boot-disk-size=50GB --worker-boot-disk-size=50GB --format=json --region=us-central1 --max-age=2h Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801680015Z STDOUT: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801687695Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801694424Z STDERR: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801701709Z Waiting on operation [projects/cloud-dataproc-ci/regions/us-central1/operations/818377df-1a27-3811-8880-f1148f36788d]. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801708353Z Waiting for cluster creation operation... Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801715237Z WARNING: For PD-Standard without local SSDs, we strongly recommend provisioning 1TB or larger to ensure consistently high I/O performance. See https://cloud.google.com/compute/docs/disks/performance for information on disk I/O performance. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801788719Z .................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................done. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801818395Z ERROR: (gcloud.dataproc.clusters.create) Operation [projects/cloud-dataproc-ci/regions/us-central1/operations/818377df-1a27-3811-8880-f1148f36788d] failed: Multiple Errors: Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801848104Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063953-ejio/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c3bfac0-2ea7-43e2-9332-662c9cfa3558/test-bigtable-ha-2-0-20221203-064014-3mu7-m-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801855375Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063953-ejio/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c3bfac0-2ea7-43e2-9332-662c9cfa3558/test-bigtable-ha-2-0-20221203-064014-3mu7-m-1/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801865740Z - Cannot start master: Timed out waiting for 2 nodes. This usually happens when VM to VM communications are blocked by firewall rules. For additional details, see https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/network#firewall_rule_requirement Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801874398Z Operation timed out: Only 0 out of 2 minimum required datanodes running. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801881670Z Operation timed out: Only 0 out of 2 minimum required node managers running. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.801888868Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063953-ejio/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c3bfac0-2ea7-43e2-9332-662c9cfa3558/test-bigtable-ha-2-0-20221203-064014-3mu7-w-0/dataproc-initialization-script-0_output Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823469677Z - Initialization action timed out. Failed action 'gs://dataproc-init-actions-test-cloud-dataproc-ci/20221203-063953-ejio/bigtable/bigtable.sh', see output in: gs://dataproc-108de5de-43c2-4a4b-979a-adebc15a58a8-us-central1/google-cloud-dataproc-metainfo/5c3bfac0-2ea7-43e2-9332-662c9cfa3558/test-bigtable-ha-2-0-20221203-064014-3mu7-w-1/dataproc-initialization-script-0_output. Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823552026Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823564257Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823573127Z ---------------------------------------------------------------------- Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823580868Z Ran 1 test in 2030.645s Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823587188Z Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823634669Z FAILED (failures=1) Step #6 - "dataproc-2.0-rocky8-tests": 2022-12-03T07:13:25.823646148Z ================================================================================ TIMEOUT ERROR: context deadline exceeded Step #4 - "dataproc-1.5-ubuntu18-tests": ++ [[ 0 != 0 ]] Step #4 - "dataproc-1.5-ubuntu18-tests": ++ kubectl delete pods presubmit-1-5-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #5 - "dataproc-2.0-debian10-tests": ++ [[ 0 != 0 ]] Step #5 - "dataproc-2.0-debian10-tests": ++ kubectl delete pods presubmit-2-0-debian10-0bf75426-6e63-48ba-bd59-6306458e9170 Step #7 - "dataproc-2.0-ubuntu18-tests": ++ [[ 0 != 0 ]] Step #7 - "dataproc-2.0-ubuntu18-tests": ++ kubectl delete pods presubmit-2-0-ubuntu18-0bf75426-6e63-48ba-bd59-6306458e9170 Step #6 - "dataproc-2.0-rocky8-tests": ++ [[ 0 != 0 ]] Step #6 - "dataproc-2.0-rocky8-tests": ++ kubectl delete pods presubmit-2-0-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #3 - "dataproc-1.5-rocky8-tests": ++ [[ 0 != 0 ]] Step #3 - "dataproc-1.5-rocky8-tests": ++ kubectl delete pods presubmit-1-5-rocky8-0bf75426-6e63-48ba-bd59-6306458e9170 Step #2 - "dataproc-1.5-debian10-tests": ++ [[ 0 != 0 ]] Step #2 - "dataproc-1.5-debian10-tests": ++ kubectl delete pods presubmit-1-5-debian10-0bf75426-6e63-48ba-bd59-6306458e9170