Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

x/build: plan9-386 builder fails #29801

Open
bradfitz opened this issue Jan 17, 2019 · 35 comments
Open

x/build: plan9-386 builder fails #29801

bradfitz opened this issue Jan 17, 2019 · 35 comments
Assignees
Labels
Builders x/build issues (builders, bots, dashboards) help wanted NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Milestone

Comments

@bradfitz
Copy link
Contributor

@0intro, what's doing on here?

/cc @bcmills @dmitshur

bradfitz@gdev:~/src/golang.org/x/build$ debugnewvm -host=host-plan9-386-gce -rev=6e9f664b9a68f2de84be9697c6ac851c7c7e1c26 -run-build=plan9-386
2019/01/17 22:00:47 Creating debug-temp-1547762447 (with VM image "plan9-386-v7")
2019/01/17 22:00:52 instance requested
2019/01/17 22:01:16 instance created
2019/01/17 22:01:16 got instance info
2019/01/17 22:01:16 About to hit http://10.240.0.4 to see if buildlet is up yet...
2019/01/17 22:01:16 SERIAL: SeaBIOS (version 1.8.2-20181112_143635-google)
                            Total RAM Size = 0x00000000e6600000 = 3686 MiB
                            CPUs found: 4     Max CPUs supported: 4
                            found virtio-scsi at 0:3
                            virtio-scsi vendor='Google' product='PersistentDisk' rev='1' type=0 removable=0
                            virtio-scsi blksize=512 sectors=20971520 = 10240 MiB
                            drive 0x000f29f0: PCHS=0/0/0 translation=lba LCHS=1024/255/63 s=20971520
                            Booting from Hard Disk 0...
                            pcirouting: BIOS workaround: PCI.0.1.3 at pin 1 link 96 irq 10 -> 9

                            no vga; serial console only
                             disk loader

                            cpu0:  2503MHz GenuineIntel P6 (cpuid: AX 0x306E4 DX 0x1F8BFBFF)
                            ELCR: 0C00
                            497M memory: 497M kernel data, 0M user, 18M swap
                            found partition #S/sd01/data 0 20,971,520
                            disks: sd01
                            trying sd01....found 9pccpuf
                            .1177998...............................................................................................................................................+2411120.......................................................................................................................................................................................................................................................................................................+488404=4077522
                            entry: 0xf0100020

                            Plan 9
                            E820: 00000000 0009fc00 memory
                            E820: 0009fc00 000a0000 reserved
                            E820: 000f0000 00100000 reserved
                            E820: 00100000 bfffd000 memory
                            E820: bfffd000 c0000000 reserved
                            E820: fffbc000 100000000 reserved
                            E820: 100000000 126600000 memory
                            cpu0:  2502MHz GenuineIntel P6 (cpuid: AX 0x306E4 DX 0x1F8BFBFF)
                            ELCR: 0C00
                            #l0: virtio: 1Gbps port 0xC040 irq 11: 42010af00004
                            3072M memory: 184M kernel data, 2887M user, 3512M swap
                            /boot/usbd: /dev/usb: no hubs
                            /boot/usbd: /dev/usb: no hubs
                            boot: can't open /srv/usb: '/srv/usb' file does not exist
                            time...
                            fossil(#S/sd01/fossil)...version...aux/randfs: '/bin/aux/randfs' does not exist
                            downloading git
....
....
2019/01/17 22:01:51 About to hit http://10.240.0.4 to see if buildlet is up yet...
2019/01/17 22:01:52 SERIAL: starting buildlet script
2019/01/17 22:01:52 About to hit http://10.240.0.4 to see if buildlet is up yet...
2019/01/17 22:01:52 client buildlet probe error: Get http://10.240.0.4: dial tcp 10.240.0.4:80: connect: connection refused
2019/01/17 22:01:53 SERIAL: 2019/01/17 17:01:51 buildlet starting.
                            2019/01/17 17:01:51 Will listen on :80
                            2019/01/17 17:01:51 Adjusted MTU.
                            2019/01/17 17:01:51 Listening on :80 ...
2019/01/17 22:01:53 About to hit http://10.240.0.4 to see if buildlet is up yet...
2019/01/17 22:01:53 buildlet probe: 200 OK
2019/01/17 22:01:53 WorkDir: /tmp/workdir, <nil>
2019/01/17 22:01:53 Pushing 'go1.4' Go bootstrap dir ...
2019/01/17 22:01:54 SERIAL: 2019/01/17 17:01:52 writetgz: untarring https://storage.googleapis.com/go-builder-data/gobootstrap-plan9-386.tar.gz (got heade
2019/01/17 22:02:02 Pushing 'go' dir...
2019/01/17 22:02:02 SERIAL: 2019/01/17 17:02:01 extracted tarball into /tmp/workdir/go1.4: 3521 files, 479 dirs (8.680247435s)
2019/01/17 22:02:04 SERIAL: 2019/01/17 17:02:02 writetgz: untarring https://go.googlesource.com/go/+archive/6e9f664b9a68f2de84be9697c6ac851c7c7e1c26.tar.g
2019/01/17 22:02:17 Running src/all.rc ...
:: Running /tmp/workdir/go/src/all.rc with args ["/tmp/workdir/go/src/all.rc"] and env ["terminal=generic /sys/src/9/pc/pccpuf" "cputype=386" "service=cpu" "bootfile=sd01!9fat!9pccpuf" "nobootprompt=local!#S/sd01/fossil" "bootargs=local!#S/sd01/fossil" "bootdisk=#S/sd01/fossil" "console=0 b115200" "dmamode=ask" "installurl=http://148.251.6.120/plan9/download" "partition=new" "mouseport=ps2intellimouse" "monitor=vesa" "vgasize=1280x1024x32" "user=glenda" "sd01part=plan9 63 20964825/9fat 63 204863/nvram 204863 204864/fossil 204864 19916249/swap 19916249 20964825" "rootdir=/root" "objtype=386" "timezone=EST -18000 EDT -14400\n   9943200   25664400   41392800   57718800   73447200   89168400\n 104896800  120618000  126669600  152067600  162352800  183517200\n 199245600  215571600  230695200  247021200  262749600  278470800\n 294199200  309920400  325648800  341370000  357098400  372819600\n 388548000  404874000  419997600  436323600  452052000  467773200\n 483501600  499222800  514951200  530672400  544586400  562122000\n 576036000  594176400  607485600  625626000  638935200  657075600\n 670989600  688525200  702439200  719974800  733888800  752029200\n 765338400  783478800  796788000  814928400  828842400  846378000\n 860292000  877827600  891741600  909277200  923191200  941331600\n 954640800  972781200  986090400 1004230800 1018144800 1035680400\n1049594400 1067130000 1081044000 1099184400 1112493600 1130634000\n1143943200 1162083600 1173578400 1194141600 1205028000 1225591200\n1236477600 1257040800 1268532000 1289095200 1299981600 1320544800\n1331431200 1351994400 1362880800 1383444000 1394330400 1414893600\n1425780000 1446343200 1457834400 1478397600 1489284000 1509847200\n1520733600 1541296800 1552183200 1572746400 1583632800 1604196000\n1615687200 1636250400 1647136800 1667700000 1678586400 1699149600\n1710036000 1730599200 1741485600 1762048800 1772935200 1793498400\n1804989600 1825552800 1836439200 1857002400 1867888800 1888452000\n1899338400 1919901600 1930788000 1951351200 1962842400 1983405600\n1994292000 2014855200 2025741600 2046304800 2057191200 2077754400\n2088640800 2109204000 2120090400 2140653600\n" "home=/usr/glenda" "path=.\x00/bin" "*=" "rcname=rc" "pid=111" "ifs= \t\n" "prompt=helix# \x00\t" "status=" "fn#sigexit=" "cflag=" "0=/rc/lib/rcmain" "boottime=Thu Jan 17 17:01:07 EST 2019\n" "sysname=helix" "NPROC=1" "site=DOM.EXAMPLE.COM" "fileserver=kfs" "facedom=FACEDOM" "apid=102" "GOROOT_BOOTSTRAP=/tmp/workdir/go1.4" "WORKDIR=/tmp/workdir" "GO_BUILDER_NAME=plan9-386" "GO_TEST_TIMEOUT_SCALE=2"] in dir /tmp/workdir/go/src

Building Go cmd/dist using /tmp/workdir/go1.4
2019/01/17 22:02:18 SERIAL: 2019/01/17 17:02:16 extracted tarball into /tmp/workdir/go: 8560 files, 1062 dirs (13.428815549s)
                            2019/01/17 17:02:16 writetgz: untarring Request.Body into /tmp/workdir/go
                            2019/01/17 17:02:16 extracted tarball into /tmp/workdir/go: 1 files, 1 dirs (3.462171ms)
                            2019/01/17 17:02:16 [0x108188f0] Running /tmp/workdir/go/src/all.rc with args ["/tmp/workdir/go/src/all.rc"] and env ["termina


Building Go toolchain1 using /tmp/workdir/go1.4.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for plan9/386.

##### Testing packages.
ok      archive/tar     0.130s
ok      archive/zip     2.249s
ok      bufio   0.158s
ok      bytes   2.061s
ok      compress/bzip2  0.109s
ok      compress/flate  1.457s
ok      compress/gzip   7.835s
ok      compress/lzw    0.145s
ok      compress/zlib   0.768s
ok      container/heap  0.047s


ok      container/list  0.041s
ok      container/ring  0.049s
ok      context 1.147s
ok      crypto  0.041s
ok      crypto/aes      0.065s
ok      crypto/cipher   27.555s
ok      crypto/des      0.059s
ok      crypto/dsa      0.044s
ok      crypto/ecdsa    0.235s
ok      crypto/elliptic 0.070s
ok      crypto/hmac     0.038s
ok      crypto/internal/subtle  0.039s
ok      crypto/md5      0.049s
ok      crypto/rand     0.299s
ok      crypto/rc4      0.090s
ok      crypto/rsa      0.198s
ok      crypto/sha1     0.099s
ok      crypto/sha256   0.050s
ok      crypto/sha512   0.051s
ok      crypto/subtle   0.045s
ok      crypto/tls      14.012s
ok      crypto/x509     6.525s
ok      database/sql    0.770s
ok      database/sql/driver     0.039s
ok      debug/dwarf     0.091s
ok      debug/elf       0.111s
ok      debug/gosym     0.040s
ok      debug/macho     0.045s
ok      debug/pe        0.055s
ok      debug/plan9obj  0.040s
ok      encoding/ascii85        0.043s
ok      encoding/asn1   0.052s
ok      encoding/base32 0.071s
ok      encoding/base64 0.047s
ok      encoding/binary 0.045s
ok      encoding/csv    0.047s
ok      encoding/gob    0.077s
ok      encoding/hex    0.043s
ok      encoding/json   0.571s
ok      encoding/pem    0.057s
ok      encoding/xml    0.108s
ok      errors  0.038s
ok      expvar  0.053s
ok      flag    0.042s
ok      fmt     0.114s
ok      go/ast  0.064s
ok      go/build        2.111s
ok      go/constant     0.047s
ok      go/doc  0.117s
ok      go/format       0.054s
ok      go/importer     0.861s
ok      go/internal/gccgoimporter       0.079s
ok      go/internal/gcimporter  6.813s
ok      go/internal/srcimporter 4.114s
ok      go/parser       0.065s
ok      go/printer      0.326s
ok      go/scanner      0.045s
ok      go/token        0.062s
ok      go/types        5.103s
ok      hash    0.043s
ok      hash/adler32    0.050s
ok      hash/crc32      0.051s
ok      hash/crc64      0.041s
ok      hash/fnv        0.042s
ok      html    0.043s
2019/01/17 22:20:49 SERIAL: 5902 template.test: checked 2245 page table entries
                            5902 template.test: checked 2247 page table entries
                            5902 template.test: checked 2247 page table entries
                            5902 template.test: checked 2247 page table entries
                            5902 template.test: checked 2251 page table entries
                            5902 template.test: checked 2251 page table entries
                            5902 template.test: checked 2251 page table entries
                            5902 template.test: checked 2251 page table entries
                            5902 template.test: checked 2253 page table entries
                            5902 template.test: checked 2253 page table entries
                            5902 template.test: checked 2256 page table entries
                            5902 template.test: checked 2256 page table entries
                            5902 template.test: checked 2256 page table entries
                            5902 template.test: checked 2256 page table entries
                            5902 template.test: checked 2256 page table entries
                            5902 template.test: checked 2256 page table entries
                            5902 template.test: checked 2257 page table entries
                            5902 template.test: checked 2257 page table entries
                            5902 template.test: c
ok      html/template   0.240s
2019/01/17 22:20:49 SERIAL: hecked 2257 page table entries
                            5902 template.test: checked 2257 page table entries
                            5902 template.test: checked 2258 page table entries
                            5902 template.test: checked 2258 page table entries
                            5902 template.test: checked 2258 page table entries
                            5902 template.test: checked 2258 page table entries
                            5902 template.test: checked 2260 page table entries
                            5902 template.test: checked 2260 page table entries
                            5902 template.test: checked 2266 page table entries
                            5902 template.test: checked 2266 page table entries
                            5902 template.test: checked 2310 page table entries
                            5902 template.test: checked 2312 page table entries
ok      image   0.118s
ok      image/color     0.057s
ok      image/draw      0.095s
ok      image/gif       0.948s
ok      image/jpeg      0.251s
ok      image/png       0.099s
ok      index/suffixarray       0.042s
ok      internal/cpu    0.041s
ok      internal/fmtsort        0.041s
ok      internal/poll   0.074s
ok      internal/singleflight   0.050s
ok      internal/trace  2.602s
ok      internal/x/crypto/chacha20poly1305      8.636s
ok      internal/x/crypto/cryptobyte    0.060s
2019/01/17 22:22:09 SERIAL: 6431 cryptobyte.test: checked 1392 page table entries
ok      internal/x/crypto/curve25519    0.177s
ok      internal/x/crypto/hkdf  0.845s
ok      internal/x/crypto/internal/chacha20     0.144s
ok      internal/x/crypto/poly1305      0.054s
ok      internal/x/net/dns/dnsmessage   0.185s
ok      internal/x/net/http/httpguts    0.042s
ok      internal/x/net/http/httpproxy   0.109s
2019/01/17 22:22:26 SERIAL: 6562 httpproxy.test: checked 1360 page table entries
                            6562 httpproxy.test: checked 1361 page table entries
                            6562 httpproxy.test: checked 1361 page table entries
                            6562 httpproxy.test: checked 1361 page table entries
                            6562 httpproxy.test: checked 1361 page table entries
                            6562 httpproxy.test: checked 1361 page table entries
                            6562 httpproxy.test: checked 1363 page table entries
                            6562 httpproxy.test: checked 1363 page table entries
ok      internal/x/net/http2/hpack      0.076s
ok      internal/x/net/idna     0.044s
ok      internal/x/net/nettest  9.947s
ok      internal/x/text/transform       0.045s
ok      internal/x/text/unicode/norm    0.043s
ok      internal/xcoff  0.168s
ok      io      0.206s
ok      io/ioutil       10.703s
ok      log     0.053s
ok      math    0.060s
ok      math/big        2.184s
ok      math/bits       0.048s
ok      math/cmplx      0.042s
ok      math/rand       0.668s
ok      mime    0.047s
ok      mime/multipart  2.525s
ok      mime/quotedprintable    0.420s
ok      net     28.558s
2019/01/17 22:25:56 SERIAL: 8008 http.test: checked 3947 page table entries
                            8008 http.test: checked 3947 page table entries
                            8008 http.test: checked 3947 page table entries
                            8008 http.test: checked 3948 page table entries
                            8008 http.test: checked 3948 page table entries
                            8008 http.test: checked 3948 page table entries
                            8008 http.test: checked 3948 page table entries
                            8008 http.test: checked 3948 page table entries
ok      net/http        143.781s
ok      net/http/cgi    0.263s
ok      net/http/cookiejar      0.240s
ok      net/http/fcgi   0.070s
ok      net/http/httptest       2.314s
ok      net/http/httptrace      0.056s
ok      net/http/httputil       4.702s
ok      net/http/internal       0.043s
ok      net/http/pprof  2.089s
ok      net/mail        0.053s
ok      net/rpc 1.706s
ok      net/rpc/jsonrpc 0.069s
ok      net/smtp        1.060s
ok      net/textproto   0.043s
ok      net/url 0.056s
ok      os      2.706s
ok      os/exec 2.556s
ok      os/signal       0.199s
ok      os/user 0.047s
ok      path    0.044s
ok      path/filepath   0.343s
ok      plugin  0.040s
ok      reflect 0.266s
2019/01/17 22:30:28 SERIAL: 8794 reflect.test: checked 2508 page table entries
                            8794 reflect.test: checked 2509 page table entries
                            8794 reflect.test: checked 2860 page table entries
ok      regexp  0.123s
ok      regexp/syntax   0.391s
2019/01/17 22:31:25 SERIAL: 9108 testprog.exe: checked 1257 page table entries
                            9110 testprog.exe: checked 1262 page table entries
                            9110 testprog.exe: checked 1264 page table entries
                            9108 testprog.exe: checked 1264 page table entries
2019/01/17 22:31:27 SERIAL: 9076 runtime.test: checked 3427 page table entries
2019/01/17 22:31:32 SERIAL: 9073 runtime.test: checked 6386 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
                            9073 runtime.test: checked 6387 page table entries
2019/01/17 22:31:35 SERIAL: 9073 runtime.test: checked 6405 page table entries
                            9076 runtime.test: checked 6410 page table entries
                            9076 runtime.test: checked 6412 page table entries
ok      runtime 55.642s
ok      runtime/debug   0.055s
ok      runtime/internal/atomic 0.125s
2019/01/17 22:32:18 SERIAL: 9322 atomic.test: checked 1372 page table entries
                            9322 atomic.test: checked 1373 page table entries
                            9322 atomic.test: checked 1373 page table entries
                            9322 atomic.test: checked 1373 page table entries
                            9322 atomic.test: checked 1373 page table entries
                            9322 atomic.test: checked 1373 page table entries
ok      runtime/internal/math   0.039s
ok      runtime/internal/sys    0.046s
ok      runtime/pprof   2.239s
ok      runtime/pprof/internal/profile  0.045s
ok      runtime/trace   43.480s
ok      sort    0.106s
ok      strconv 0.460s
2019/01/17 22:34:25 serial output error: googleapi: Error 400: The resource 'projects/symbolic-datum-552/zones/us-central1-f/instances/debug-temp-1547762447' is not ready, resourceNotReady
2019/01/17 22:34:35 Buildlet http://10.240.0.4 failed three heartbeats; final error: timeout waiting for headers
2019/01/17 22:34:35 error trying to run src/all.rc: Buildlet http://10.240.0.4 failed heartbeat after 10.000362883s; marking dead; err=timeout waiting for headers
bradfitz@gdev:~/src/golang.org/x/build$
@bradfitz bradfitz added help wanted OS-Plan9 NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Jan 17, 2019
@gopherbot gopherbot added this to the Unreleased milestone Jan 17, 2019
@gopherbot gopherbot added the Builders x/build issues (builders, bots, dashboards) label Jan 17, 2019
@gopherbot
Copy link

Change https://golang.org/cl/158537 mentions this issue: dashboard: increase plan9's GO_TEST_TIMEOUT_SCALE

gopherbot pushed a commit to golang/build that referenced this issue Jan 18, 2019
Updates golang/go#29801

Change-Id: Ib346d717ae9b8de18666d6ea543d9bdcd2856f3b
Reviewed-on: https://go-review.googlesource.com/c/158537
Reviewed-by: Bryan C. Mills <bcmills@google.com>
@dmitshur
Copy link
Contributor

dmitshur commented Feb 18, 2019

I'm not sure if it's related to this issue, or a separate issue, but there haven't been any plan9 builder results for any of the subrepos recently. I.e., https://build.golang.org/?repo=golang.org%2fx%2ftools has no entries for plan9/386, despite the configuration suggesting there should be:

https://github.com/golang/build/blob/0261b66eb04541491e09bffe4a6d212f9a76675b/dashboard/builders.go#L881

This came up in CL 162907. /cc @rhysh

@0intro
Copy link
Member

0intro commented Feb 18, 2019

Yes, there is currently an issue happening on the plan9/386 builder. It started on 2019-02-01 approximately. I'll investigate.

@bradfitz
Copy link
Contributor Author

bradfitz commented Apr 3, 2019

What's the status here? I haven't seen a plan9/386 build pass in a long time.

@0intro
Copy link
Member

0intro commented Apr 3, 2019

I'm currently investigating an issue with the runtime/trace test running out of memory on the plan9/amd64 builder.

The issue on the plan9/386 builder is different. I've not been able to reproduce it yet, since it runs successfully on my 386 machines at home. I'll have to try on GCE.

There was something very odd on the plan9/386 builder during the past few months. The builder started to fail in early February, then after 4 weeks of failure, the tests passed successfully in early March during 8 days, then it started to fail again.

@bradfitz
Copy link
Contributor Author

I'm going to have to stop the plan9 builders. It's a waste of resources & distracting to have them always building and resulting in crashes, loops, timeouts, or other failures.

@0intro
Copy link
Member

0intro commented Apr 16, 2019

Could you try to disable the runtime/trace tests? It may be the same issue I'm currently encountering on plan9/amd64.

@0intro
Copy link
Member

0intro commented Apr 16, 2019

After a few more tests, it seems unlikely that the issue may be caused by the runtime/trace test. I'm suspecting something else. Please hang on.

@0intro
Copy link
Member

0intro commented Apr 17, 2019

I ran all.rc in a loop on GCE (n1-highcpu-4) during the night and the tests always passed successfully, except fixedbugs/issue30908.go, which is a recent issue (issue #31503).
I'm still investigating.

cpu% all.rc
Building Go cmd/dist using /tmp/go-plan9-386-bootstrap
Building Go toolchain1 using /tmp/go-plan9-386-bootstrap.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for plan9/386.

##### Testing packages.
ok  	archive/tar	0.399s
ok  	archive/zip	3.933s
ok  	bufio	0.263s
ok  	bytes	0.460s
ok  	compress/bzip2	0.278s
ok  	compress/flate	1.615s
ok  	compress/gzip	0.249s
ok  	compress/lzw	0.095s
ok  	compress/zlib	0.153s
ok  	container/heap	0.101s
ok  	container/list	0.101s
ok  	container/ring	0.103s
ok  	context	1.181s
ok  	crypto	0.135s
ok  	crypto/aes	0.098s
ok  	crypto/cipher	24.318s
ok  	crypto/des	0.095s
ok  	crypto/dsa	0.101s
ok  	crypto/ecdsa	0.307s
ok  	crypto/elliptic	0.131s
ok  	crypto/hmac	0.093s
ok  	crypto/internal/subtle	0.097s
ok  	crypto/md5	0.113s
ok  	crypto/rand	0.350s
ok  	crypto/rc4	0.138s
ok  	crypto/rsa	0.309s
ok  	crypto/sha1	0.139s
ok  	crypto/sha256	0.107s
ok  	crypto/sha512	0.166s
ok  	crypto/subtle	0.100s
ok  	crypto/tls	14.739s
ok  	crypto/x509	7.937s
ok  	database/sql	0.924s
ok  	database/sql/driver	0.089s
ok  	debug/dwarf	0.356s
ok  	debug/elf	0.212s
ok  	debug/gosym	0.118s
ok  	debug/macho	0.174s
ok  	debug/pe	0.186s
ok  	debug/plan9obj	0.102s
ok  	encoding/ascii85	0.094s
ok  	encoding/asn1	0.132s
ok  	encoding/base32	0.121s
ok  	encoding/base64	0.091s
ok  	encoding/binary	0.105s
ok  	encoding/csv	0.127s
ok  	encoding/gob	0.164s
ok  	encoding/hex	0.098s
ok  	encoding/json	0.843s
ok  	encoding/pem	0.148s
ok  	encoding/xml	0.191s
ok  	errors	0.105s
ok  	expvar	0.155s
ok  	flag	0.101s
ok  	fmt	0.249s
ok  	go/ast	0.138s
ok  	go/build	4.557s
ok  	go/constant	0.110s
ok  	go/doc	0.583s
ok  	go/format	0.129s
ok  	go/importer	1.511s
ok  	go/internal/gccgoimporter	0.357s
ok  	go/internal/gcimporter	3.825s
ok  	go/internal/srcimporter	5.533s
ok  	go/parser	0.208s
ok  	go/printer	0.587s
ok  	go/scanner	0.191s
ok  	go/token	0.144s
ok  	go/types	3.114s
ok  	hash	0.098s
ok  	hash/adler32	0.090s
ok  	hash/crc32	0.101s
ok  	hash/crc64	0.119s
ok  	hash/fnv	0.092s
ok  	html	0.097s
ok  	html/template	0.323s
ok  	image	0.276s
ok  	image/color	0.099s
ok  	image/draw	0.164s
ok  	image/gif	0.653s
ok  	image/jpeg	0.382s
ok  	image/png	0.273s
ok  	index/suffixarray	0.102s
ok  	internal/cpu	0.091s
ok  	internal/fmtsort	0.089s
ok  	internal/poll	0.135s
ok  	internal/reflectlite	0.186s
ok  	internal/singleflight	0.107s
ok  	internal/trace	2.836s
ok  	internal/xcoff	0.243s
ok  	io	0.274s
ok  	io/ioutil	9.361s
ok  	log	0.150s
ok  	math	0.227s
ok  	math/big	2.275s
ok  	math/bits	0.095s
ok  	math/cmplx	0.096s
ok  	math/rand	0.334s
ok  	mime	0.129s
ok  	mime/multipart	4.919s
ok  	mime/quotedprintable	0.332s
ok  	net	20.813s
ok  	net/http	115.650s
ok  	net/http/cgi	0.353s
ok  	net/http/cookiejar	0.364s
ok  	net/http/fcgi	0.127s
ok  	net/http/httptest	2.517s
ok  	net/http/httptrace	0.137s
ok  	net/http/httputil	4.862s
ok  	net/http/internal	0.100s
ok  	net/http/pprof	2.209s
ok  	net/mail	0.112s
ok  	net/rpc	1.801s
ok  	net/rpc/jsonrpc	0.206s
ok  	net/smtp	1.553s
ok  	net/textproto	0.132s
ok  	net/url	0.140s
ok  	os	2.301s
ok  	os/exec	2.012s
ok  	os/signal	0.217s
ok  	os/user	0.092s
ok  	path	0.178s
ok  	path/filepath	1.355s
ok  	plugin	0.093s
ok  	reflect	0.421s
ok  	regexp	0.276s
ok  	regexp/syntax	0.450s
ok  	runtime	29.434s
ok  	runtime/debug	0.115s
ok  	runtime/internal/atomic	0.181s
ok  	runtime/internal/math	0.084s
ok  	runtime/internal/sys	0.081s
ok  	runtime/pprof	7.533s
ok  	runtime/pprof/internal/profile	0.093s
ok  	runtime/trace	95.536s
ok  	sort	0.115s
ok  	strconv	0.452s
ok  	strings	0.209s
ok  	sync	1.777s
ok  	sync/atomic	0.226s
ok  	syscall	0.066s
ok  	testing	0.931s
ok  	testing/quick	0.150s
ok  	text/scanner	0.087s
ok  	text/tabwriter	0.067s
ok  	text/template	0.405s
ok  	text/template/parse	0.069s
ok  	time	5.222s
ok  	unicode	0.070s
ok  	unicode/utf16	0.060s
ok  	unicode/utf8	0.069s
ok  	cmd/addr2line	10.317s
ok  	cmd/api	0.282s
ok  	cmd/asm/internal/asm	1.506s
ok  	cmd/asm/internal/lex	0.169s
ok  	cmd/compile	0.124s
ok  	cmd/compile/internal/gc	36.661s
ok  	cmd/compile/internal/ssa	2.809s
ok  	cmd/compile/internal/syntax	0.122s
ok  	cmd/compile/internal/test	0.052s [no tests to run]
ok  	cmd/compile/internal/types	0.083s
ok  	cmd/cover	32.063s
ok  	cmd/doc	0.384s
ok  	cmd/fix	23.168s
ok  	cmd/go	1056.432s
ok  	cmd/go/internal/cache	5.862s
ok  	cmd/go/internal/dirhash	0.113s
ok  	cmd/go/internal/generate	0.208s
ok  	cmd/go/internal/get	0.281s
ok  	cmd/go/internal/imports	0.239s
ok  	cmd/go/internal/load	0.140s
ok  	cmd/go/internal/lockedfile	0.146s
ok  	cmd/go/internal/modconv	0.382s
ok  	cmd/go/internal/modfetch	0.216s
ok  	cmd/go/internal/modfetch/codehost	0.120s
ok  	cmd/go/internal/modfile	0.235s
ok  	cmd/go/internal/modload	0.213s
ok  	cmd/go/internal/module	0.070s
ok  	cmd/go/internal/mvs	0.118s
ok  	cmd/go/internal/par	0.092s
ok  	cmd/go/internal/search	0.128s
ok  	cmd/go/internal/semver	0.080s
ok  	cmd/go/internal/txtar	0.081s
ok  	cmd/go/internal/web2	0.161s
ok  	cmd/go/internal/work	0.199s
ok  	cmd/gofmt	0.468s
ok  	cmd/internal/buildid	0.404s
ok  	cmd/internal/dwarf	0.108s
ok  	cmd/internal/edit	0.175s
ok  	cmd/internal/goobj	1.718s
ok  	cmd/internal/obj	0.083s
ok  	cmd/internal/obj/arm64	0.723s
ok  	cmd/internal/obj/x86	15.337s
ok  	cmd/internal/objabi	0.077s
ok  	cmd/internal/src	0.110s
ok  	cmd/internal/test2json	0.226s
ok  	cmd/link	4.910s
ok  	cmd/link/internal/ld	2.820s
ok  	cmd/link/internal/sym	0.092s
ok  	cmd/nm	10.848s
ok  	cmd/objdump	10.740s
ok  	cmd/pack	13.695s
ok  	cmd/trace	0.238s
ok  	cmd/vet	112.529s

##### os/user with tag osusergo
ok  	os/user	0.175s

##### GOMAXPROCS=2 runtime -cpu=1,2,4 -quick
ok  	runtime	63.371s

##### Testing without libgcc.
ok  	crypto/x509	25.206s
ok  	net	1.117s
ok  	os/user	0.087s

##### sync -cpu=10
ok  	sync	2.163s

##### ../test/bench/go1
testing: warning: no tests to run
PASS
ok  	test/bench/go1	57.044s

##### ../test
# go run run.go -- fixedbugs/issue30908.go
exit status: 'go 66926: 1'
cmd/link: while reading object for 'a': duplicate symbol 'go.info.go.builtin.error.Error', previous def at 'runtime', with mismatched payload: new length 52 != old length 40
cmd/link: while reading object for 'bytes': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'path/filepath': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strconv': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strings': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15

FAIL	fixedbugs/issue30908.go	2.588s
2019/04/16 21:33:15 Failed: exit status: 'runtest.exe 41937: 1'

##### API check
+pkg database/sql, method (*NullTime) Scan(interface{}) error
+pkg database/sql, method (NullTime) Value() (driver.Value, error)
+pkg database/sql, type NullTime struct
+pkg database/sql, type NullTime struct, Time time.Time
+pkg database/sql, type NullTime struct, Valid bool
+pkg debug/dwarf, method (*UnsupportedType) Common() *CommonType
+pkg debug/dwarf, method (*UnsupportedType) Size() int64
+pkg debug/dwarf, method (*UnsupportedType) String() string
+pkg debug/dwarf, type UnsupportedType struct
+pkg debug/dwarf, type UnsupportedType struct, Tag Tag
+pkg debug/dwarf, type UnsupportedType struct, embedded CommonType
+pkg errors, func As(error, interface{}) bool
+pkg errors, func Caller(int) Frame
+pkg errors, func Is(error, error) bool
+pkg errors, func Opaque(error) error
+pkg errors, func Unwrap(error) error
+pkg errors, method (Frame) Format(Printer)
+pkg errors, type Formatter interface { Error, FormatError }
+pkg errors, type Formatter interface, Error() string
+pkg errors, type Formatter interface, FormatError(Printer) error
+pkg errors, type Frame struct
+pkg errors, type Printer interface { Detail, Print, Printf }
+pkg errors, type Printer interface, Detail() bool
+pkg errors, type Printer interface, Print(...interface{})
+pkg errors, type Printer interface, Printf(string, ...interface{})
+pkg errors, type Wrapper interface { Unwrap }
+pkg errors, type Wrapper interface, Unwrap() error
+pkg go/constant, func Make(interface{}) Value
+pkg go/constant, func Val(Value) interface{}
+pkg go/token, func IsExported(string) bool
+pkg go/token, func IsIdentifier(string) bool
+pkg go/token, func IsKeyword(string) bool
+pkg log, func Writer() io.Writer
+pkg math/big, method (*Int) TrailingZeroBits() uint
+pkg math/big, method (*Rat) SetUint64(uint64) *Rat
+pkg net, type ListenConfig struct, KeepAlive time.Duration
+pkg net/http, const StatusEarlyHints = 103
+pkg net/http, const StatusEarlyHints ideal-int
+pkg net/http, type Server struct, BaseContext func(net.Listener) context.Context
+pkg net/http, type Server struct, ConnContext func(context.Context, net.Conn) context.Context
+pkg net/http, type Transport struct, ForceAttemptHTTP2 bool
+pkg os, func UserConfigDir() (string, error)
+pkg os, method (*LinkError) Unwrap() error
+pkg os, method (*PathError) Unwrap() error
+pkg os, method (*SyscallError) Unwrap() error
+pkg os, var ErrTimeout error
+pkg os/exec, method (*Cmd) String() string
+pkg reflect, method (Value) IsZero() bool
+pkg syscall, method (Errno) Is(error) bool
+pkg testing, method (*B) ReportMetric(float64, string)
+pkg testing, type BenchmarkResult struct, Extra map[string]float64
+pkg time, method (Duration) Microseconds() int64
+pkg time, method (Duration) Milliseconds() int64
2019/04/16 21:33:38 FAILED

@bradfitz
Copy link
Contributor Author

The builders don't run all.rc or all.bash, etc. They run make.ext and then use go tool dist test to run the tests. Maybe something's broken with Plan 9's subprocess handling.

@gopherbot
Copy link

Change https://golang.org/cl/172797 mentions this issue: dashboard: disable plan9-386 builder

@0intro
Copy link
Member

0intro commented Apr 18, 2019

Could you give me a builder key so I could run the plan9/386 buildlet on my side and debug it?

@bradfitz
Copy link
Contributor Author

You can use the buildlet & debugnewvm (perhaps modified) to test it.

gopherbot pushed a commit to golang/build that referenced this issue Apr 18, 2019
It hasn't passed in months and now spins, wasting resources.

Updates golang/go#31261
Updates golang/go#29801

Change-Id: Idcf13ae915bad4febb156c5c5d49f07f76cf9d49
Reviewed-on: https://go-review.googlesource.com/c/build/+/172797
Run-TryBot: Brad Fitzpatrick <bradfitz@golang.org>
TryBot-Result: Gobot Gobot <gobot@golang.org>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
@0intro
Copy link
Member

0intro commented Apr 18, 2019

I figured how to use debugnewvm, then ran the plan9/386 build. The tests passed successfully, except the issue30908 test (issue #31503). Now, I'm puzzled.

$ go run debugnewvm.go -host host-plan9-386-gce -run-build plan9-386
2019/04/18 23:19:40 Creating debug-temp-1555622380 (with VM image "plan9")
2019/04/18 23:19:43 instance requested
2019/04/18 23:19:52 instance created
2019/04/18 23:19:52 got instance info
2019/04/18 23:19:52 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:19:53 SERIAL: SeaBIOS (version 1.8.2-20190322_093631-google)
                            Total RAM Size = 0x00000000e6600000 = 3686 MiB
                            CPUs found: 4     Max CPUs supported: 4
                            found virtio-scsi at 0:3
                            virtio-scsi vendor='Google' product='PersistentDisk' rev='1' type=0 removable=0
                            virtio-scsi blksize=512 sectors=20971520 = 10240 MiB
                            drive 0x000f2bf0: PCHS=0/0/0 translation=lba LCHS=1024/255/63 s=20971520
                            Booting from Hard Disk 0...
                            pcirouting: BIOS workaround: PCI.0.1.3 at pin 1 link 96 irq 10 -> 9
                            
                            no vga; serial console only
                             disk loader
                            
                            cpu0:  2298MHz GenuineIntel P6 (cpuid: AX 0x306F0 DX 0x1F8BFBFF)
                            ELCR: 0C00
                            497M memory: 497M kernel data, 0M user, 18M swap
                            found partition #S/sd01/data 0 20,971,520
                            disks: sd01
                            trying sd01....found 9pccpuf
                            .1178434...............................................................................................................................................+2414552.......................................................................................................................................................................................................................................................................................................+489820=4082806
                            entry: 0xf0100020
                            
                            Plan 9
                            E820: 00000000 0009fc00 memory
                            E820: 0009fc00 000a0000 reserved
                            E820: 000f0000 00100000 reserved
                            E820: 00100000 bfffd000 memory
                            E820: bfffd000 c0000000 reserved
                            E820: fffbc000 100000000 reserved
                            E820: 100000000 126600000 memory
                            cpu0:  2301MHz GenuineIntel P6 (cpuid: AX 0x306F0 DX 0x1F8BFBFF)
                            ELCR: 0C00
                            #l0: virtio: 1Gbps port 0xC040 irq 11: 42010af00011
                            3072M memory: 208M kernel data, 2863M user, 3488M swap
                            usbinit...usbd.../boot/usbd: /dev/usb: no hubs
                            no /srv/usb...
2019/04/18 23:19:54 SERIAL: no usb disk...pickmethod...read #e/nobootprompt...pickmethod done
                            bind #æ...bind #S...partinit...auth...usbinit...usbd.../boot/usbd: /dev/usb: no hubs
2019/04/18 23:19:56 SERIAL: no /srv/usb...
2019/04/18 23:19:57 client buildlet probe error: Get http://34.76.96.122: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2019/04/18 23:19:58 SERIAL: no usb disk...mount usbd...boot: can't open /srv/usb: '/srv/usb' file does not exist
                            time...
                            fossil(#S/sd01/fossil)...version...can't stat /srv/partfs.sdXX: '/srv/partfs.sdXX' file does not exist
2019/04/18 23:19:58 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:01 client buildlet probe error: Get http://34.76.96.122: dial tcp 34.76.96.122:80: connect: connection refused
2019/04/18 23:20:02 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:02 client buildlet probe error: Get http://34.76.96.122: dial tcp 34.76.96.122:80: connect: connection refused
2019/04/18 23:20:03 SERIAL: aux/randfs: '/bin/aux/randfs' does not exist
                            downloading git
2019/04/18 23:20:03 SERIAL: starting buildlet script
2019/04/18 23:20:03 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:04 client buildlet probe error: Get http://34.76.96.122: dial tcp 34.76.96.122:80: connect: connection refused
2019/04/18 23:20:04 SERIAL: 2019/04/18 17:20:04 buildlet starting.
                            2019/04/18 17:20:04 Will listen on :80
                            2019/04/18 17:20:04 Adjusted MTU.
                            2019/04/18 17:20:04 Listening on :80 ...
2019/04/18 23:20:05 About to hit http://34.76.96.122 to see if buildlet is up yet...
2019/04/18 23:20:05 buildlet probe: 200 OK
2019/04/18 23:20:05 WorkDir: /tmp/workdir, <nil>
2019/04/18 23:20:05 Pushing 'go1.4' Go bootstrap dir ...
2019/04/18 23:20:07 SERIAL: 2019/04/18 17:20:05 writetgz: untarring https://storage.googleapis.com/go-builder-data/gobootstrap-plan9-386.tar.gz (got heade
2019/04/18 23:20:12 Pushing 'go' dir...
2019/04/18 23:20:14 SERIAL: 2019/04/18 17:20:12 extracted tarball into /tmp/workdir/go1.4: 3521 files, 479 dirs (6.645937499s)
                            2019/04/18 17:20:12 writetgz: untarring https://go.googlesource.com/go/+archive/master.tar.gz (got headers in 104.127133ms) in
2019/04/18 23:20:24 Running src/all.rc ...
:: Running /tmp/workdir/go/src/all.rc with args ["/tmp/workdir/go/src/all.rc"] and env ["terminal=generic /sys/src/9/pc/pccpuf" "cputype=386" "service=cpu" "bootfile=sd01!9fat!9pccpuf" "nobootprompt=local!#S/sd01/fossil" "bootargs=local!#S/sd01/fossil" "bootdisk=#S/sd01/fossil" "console=0 b115200" "debugboot=1" "dmamode=ask" "installurl=http://148.251.6.120/plan9/download" "partition=new" "mouseport=ps2intellimouse" "monitor=vesa" "vgasize=1280x1024x32" "user=glenda" "sd01part=plan9 63 20964825/9fat 63 204863/nvram 204863 204864/fossil 204864 19916249/swap 19916249 20964825" "rootdir=/root" "objtype=386" "timezone=EST -18000 EDT -14400\n   9943200   25664400   41392800   57718800   73447200   89168400\n 104896800  120618000  126669600  152067600  162352800  183517200\n 199245600  215571600  230695200  247021200  262749600  278470800\n 294199200  309920400  325648800  341370000  357098400  372819600\n 388548000  404874000  419997600  436323600  452052000  467773200\n 483501600  499222800  514951200  530672400  544586400  562122000\n 576036000  594176400  607485600  625626000  638935200  657075600\n 670989600  688525200  702439200  719974800  733888800  752029200\n 765338400  783478800  796788000  814928400  828842400  846378000\n 860292000  877827600  891741600  909277200  923191200  941331600\n 954640800  972781200  986090400 1004230800 1018144800 1035680400\n1049594400 1067130000 1081044000 1099184400 1112493600 1130634000\n1143943200 1162083600 1173578400 1194141600 1205028000 1225591200\n1236477600 1257040800 1268532000 1289095200 1299981600 1320544800\n1331431200 1351994400 1362880800 1383444000 1394330400 1414893600\n1425780000 1446343200 1457834400 1478397600 1489284000 1509847200\n1520733600 1541296800 1552183200 1572746400 1583632800 1604196000\n1615687200 1636250400 1647136800 1667700000 1678586400 1699149600\n1710036000 1730599200 1741485600 1762048800 1772935200 1793498400\n1804989600 1825552800 1836439200 1857002400 1867888800 1888452000\n1899338400 1919901600 1930788000 1951351200 1962842400 1983405600\n1994292000 2014855200 2025741600 2046304800 2057191200 2077754400\n2088640800 2109204000 2120090400 2140653600\n" "home=/usr/glenda" "path=.\x00/bin" "*=" "rcname=rc" "pid=112" "ifs= \t\n" "prompt=helix# \x00\t" "status=" "fn#sigexit=" "cflag=" "0=/rc/lib/rcmain" "boottime=Thu Apr 18 17:19:57 EDT 2019\n" "sysname=helix" "NPROC=1" "site=DOM.EXAMPLE.COM" "fileserver=kfs" "facedom=FACEDOM" "apid=102" "WORKDIR=/tmp/workdir" "GOROOT_BOOTSTRAP=/tmp/workdir/go1.4" "GO_BUILDER_NAME=plan9-386" "GO_TEST_TIMEOUT_SCALE=3"] in dir /tmp/workdir/go/src

Building Go cmd/dist using /tmp/workdir/go1.4
2019/04/18 23:20:25 SERIAL: 2019/04/18 17:20:24 extracted tarball into /tmp/workdir/go: 8614 files, 1064 dirs (11.982278599s)
                            2019/04/18 17:20:24 writetgz: untarring Request.Body into /tmp/workdir/go
                            2019/04/18 17:20:24 extracted tarball into /tmp/workdir/go: 1 files, 1 dirs (2.826895ms)
                            2019/04/18 17:20:24 [0x10c629a0] Running /tmp/workdir/go/src/all.rc with args ["/tmp/workdir/go/src/all.rc"] and env ["termina
Building Go toolchain1 using /tmp/workdir/go1.4.
Building Go bootstrap cmd/go (go_bootstrap) using Go toolchain1.
Building Go toolchain2 using go_bootstrap and Go toolchain1.
Building Go toolchain3 using go_bootstrap and Go toolchain2.
Building packages and commands for plan9/386.

##### Testing packages.
ok      archive/tar     0.118s
ok      archive/zip     1.655s
ok      bufio   0.142s
ok      bytes   1.941s
ok      compress/bzip2  0.095s
ok      compress/flate  1.322s
ok      compress/gzip   6.907s
ok      compress/lzw    0.129s
ok      compress/zlib   0.706s
ok      container/heap  0.040s
ok      container/list  0.032s
ok      container/ring  0.039s
ok      context 1.141s
ok      crypto  0.031s
ok      crypto/aes      0.057s
ok      crypto/cipher   23.235s
ok      crypto/des      0.049s
ok      crypto/dsa      0.035s
ok      crypto/ecdsa    0.227s
ok      crypto/elliptic 0.064s
ok      crypto/hmac     0.034s
ok      crypto/internal/subtle  0.029s
ok      crypto/md5      0.035s
ok      crypto/rand     0.241s
ok      crypto/rc4      0.082s
ok      crypto/rsa      0.184s
ok      crypto/sha1     0.080s
ok      crypto/sha256   0.039s
ok      crypto/sha512   0.042s
ok      crypto/subtle   0.033s
ok      crypto/tls      13.546s
ok      crypto/x509     5.982s
ok      database/sql    0.762s
ok      database/sql/driver     0.034s
ok      debug/dwarf     0.079s
ok      debug/elf       0.095s
ok      debug/gosym     0.034s
ok      debug/macho     0.038s
ok      debug/pe        0.048s
ok      debug/plan9obj  0.032s
ok      encoding/ascii85        0.036s
ok      encoding/asn1   0.043s
ok      encoding/base32 0.056s
ok      encoding/base64 0.039s
ok      encoding/binary 0.039s
ok      encoding/csv    0.043s
ok      encoding/gob    0.075s
ok      encoding/hex    0.037s
ok      encoding/json   0.568s
ok      encoding/pem    0.050s
ok      encoding/xml    0.067s
ok      errors  0.037s
ok      expvar  0.045s
ok      flag    0.039s
ok      fmt     0.109s
ok      go/ast  0.054s
ok      go/build        1.847s
ok      go/constant     0.039s
ok      go/doc  0.108s
ok      go/format       0.044s
ok      go/importer     1.025s
ok      go/internal/gccgoimporter       0.068s
ok      go/internal/gcimporter  5.787s
ok      go/internal/srcimporter 3.948s
ok      go/parser       0.084s
ok      go/printer      0.305s
ok      go/scanner      0.037s
ok      go/token        0.057s
ok      go/types        4.557s
ok      hash    0.038s
ok      hash/adler32    0.038s
ok      hash/crc32      0.039s
ok      hash/crc64      0.033s
ok      hash/fnv        0.034s
ok      html    0.034s
ok      html/template   0.195s
ok      image   0.108s
ok      image/color     0.050s
ok      image/draw      0.084s
ok      image/gif       0.312s
ok      image/jpeg      0.239s
ok      image/png       0.085s
ok      index/suffixarray       0.037s
ok      internal/cpu    0.036s
ok      internal/fmtsort        0.037s
ok      internal/poll   0.064s
ok      internal/reflectlite    0.038s
ok      internal/singleflight   0.045s
ok      internal/trace  2.375s
ok      internal/xcoff  0.132s
ok      io      0.195s
ok      io/ioutil       8.862s
ok      log     0.041s
ok      math    0.043s
ok      math/big        2.025s
ok      math/bits       0.044s
ok      math/cmplx      0.039s
ok      math/rand       0.675s
ok      mime    0.048s
ok      mime/multipart  2.198s
ok      mime/quotedprintable    0.227s
ok      net     26.394s
ok      net/http        115.587s
ok      net/http/cgi    0.213s
ok      net/http/cookiejar      0.181s
ok      net/http/fcgi   0.052s
ok      net/http/httptest       2.130s
ok      net/http/httptrace      0.050s
ok      net/http/httputil       4.402s
ok      net/http/internal       0.036s
ok      net/http/pprof  2.081s
ok      net/mail        0.042s
ok      net/rpc 1.568s
ok      net/rpc/jsonrpc 0.067s
ok      net/smtp        1.307s
ok      net/textproto   0.039s
ok      net/url 0.051s
ok      os      2.447s
ok      os/exec 1.564s
ok      os/signal       0.166s
ok      os/user 0.039s
ok      path    0.039s
ok      path/filepath   0.311s
ok      plugin  0.036s
ok      reflect 0.240s
ok      regexp  0.111s
ok      regexp/syntax   0.384s
ok      runtime 57.823s
ok      runtime/debug   0.046s
ok      runtime/internal/atomic 0.113s
ok      runtime/internal/math   0.037s
ok      runtime/internal/sys    0.036s
ok      runtime/pprof   2.095s
ok      runtime/pprof/internal/profile  0.082s
ok      runtime/trace   50.495s
ok      sort    0.107s
ok      strconv 0.411s
ok      strings 1.433s
ok      sync    1.643s
ok      sync/atomic     0.146s
ok      syscall 0.040s
ok      testing 1.224s
ok      testing/quick   0.116s
ok      text/scanner    0.045s
ok      text/tabwriter  0.040s
ok      text/template   0.313s
ok      text/template/parse     0.051s
ok      time    5.000s
ok      unicode 0.042s
ok      unicode/utf16   0.040s
ok      unicode/utf8    0.044s
ok      cmd/addr2line   6.971s
ok      cmd/api 0.156s
ok      cmd/asm/internal/asm    0.900s
ok      cmd/asm/internal/lex    0.048s
ok      cmd/compile     0.079s
ok      cmd/compile/internal/gc 62.620s
ok      cmd/compile/internal/ssa        1.932s
ok      cmd/compile/internal/syntax     0.059s
ok      cmd/compile/internal/test       0.037s [no tests to run]
ok      cmd/compile/internal/types      0.046s
ok      cmd/cover       22.182s
ok      cmd/doc 0.211s
ok      cmd/fix 19.757s
ok      cmd/go  796.425s
ok      cmd/go/internal/cache   8.344s
ok      cmd/go/internal/dirhash 0.069s
ok      cmd/go/internal/generate        0.097s
ok      cmd/go/internal/get     0.175s
ok      cmd/go/internal/imports 0.076s
ok      cmd/go/internal/load    0.071s
ok      cmd/go/internal/lockedfile      0.095s
ok      cmd/go/internal/modconv 0.093s
ok      cmd/go/internal/modfetch        0.106s
ok      cmd/go/internal/modfetch/codehost       0.062s
ok      cmd/go/internal/modfile 0.060s
ok      cmd/go/internal/modload 0.098s
ok      cmd/go/internal/module  0.043s
ok      cmd/go/internal/mvs     0.065s
ok      cmd/go/internal/par     0.060s
ok      cmd/go/internal/search  0.063s
ok      cmd/go/internal/semver  0.041s
ok      cmd/go/internal/txtar   0.041s
ok      cmd/go/internal/web2    0.078s
ok      cmd/go/internal/work    0.132s
ok      cmd/gofmt       0.207s
ok      cmd/internal/buildid    0.291s
ok      cmd/internal/dwarf      0.051s
ok      cmd/internal/edit       0.039s
ok      cmd/internal/goobj      0.957s
ok      cmd/internal/obj        0.047s
ok      cmd/internal/obj/arm64  0.339s
ok      cmd/internal/obj/x86    10.816s
ok      cmd/internal/objabi     0.047s
ok      cmd/internal/src        0.041s
ok      cmd/internal/test2json  0.144s
ok      cmd/link        3.504s
ok      cmd/link/internal/ld    1.406s
ok      cmd/link/internal/sym   0.047s
ok      cmd/nm  6.768s
ok      cmd/objdump     7.406s
ok      cmd/pack        9.205s
ok      cmd/trace       0.091s
ok      cmd/vet 79.344s

##### os/user with tag osusergo
ok      os/user 0.047s

##### GOMAXPROCS=2 runtime -cpu=1,2,4 -quick
ok      runtime 195.913s

##### Testing without libgcc.
ok      crypto/x509     16.206s
ok      net     0.318s
ok      os/user 0.038s

##### sync -cpu=10
ok      sync    1.713s

##### ../test/bench/go1
testing: warning: no tests to run
PASS
ok      test/bench/go1  53.521s

##### ../test
# go run run.go -- fixedbugs/issue30908.go
exit status: 'go 56812: 1'
cmd/link: while reading object for 'a': duplicate symbol 'go.info.go.builtin.error.Error', previous def at 'runtime', with mismatched payload: new length 52 != old length 40
cmd/link: while reading object for 'bytes': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'path/filepath': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strconv': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15
cmd/link: while reading object for 'strings': duplicate symbol 'go.isstmt.go.builtin.error.Error', previous def at 'a', with mismatched payload: new length 0 != old length 15

FAIL    fixedbugs/issue30908.go 1.449s
2019/04/18 18:53:13 Failed: exit status: 'runtest.exe 50122: 1'

##### API check
+pkg database/sql, method (*NullTime) Scan(interface{}) error
+pkg database/sql, method (NullTime) Value() (driver.Value, error)
+pkg database/sql, type NullTime struct
+pkg database/sql, type NullTime struct, Time time.Time
+pkg database/sql, type NullTime struct, Valid bool
+pkg debug/dwarf, method (*UnsupportedType) Common() *CommonType
+pkg debug/dwarf, method (*UnsupportedType) Size() int64
+pkg debug/dwarf, method (*UnsupportedType) String() string
+pkg debug/dwarf, type UnsupportedType struct
+pkg debug/dwarf, type UnsupportedType struct, Tag Tag
+pkg debug/dwarf, type UnsupportedType struct, embedded CommonType
+pkg errors, func As(error, interface{}) bool
+pkg errors, func Caller(int) Frame
+pkg errors, func Is(error, error) bool
+pkg errors, func Opaque(error) error
+pkg errors, func Unwrap(error) error
+pkg errors, method (Frame) Format(Printer)
+pkg errors, type Formatter interface { Error, FormatError }
+pkg errors, type Formatter interface, Error() string
+pkg errors, type Formatter interface, FormatError(Printer) error
+pkg errors, type Frame struct
+pkg errors, type Printer interface { Detail, Print, Printf }
+pkg errors, type Printer interface, Detail() bool
+pkg errors, type Printer interface, Print(...interface{})
+pkg errors, type Printer interface, Printf(string, ...interface{})
+pkg errors, type Wrapper interface { Unwrap }
+pkg errors, type Wrapper interface, Unwrap() error
+pkg go/constant, func Make(interface{}) Value
+pkg go/constant, func Val(Value) interface{}
+pkg go/token, func IsExported(string) bool
+pkg go/token, func IsIdentifier(string) bool
+pkg go/token, func IsKeyword(string) bool
+pkg log, func Writer() io.Writer
+pkg math/big, method (*Int) TrailingZeroBits() uint
+pkg math/big, method (*Rat) SetUint64(uint64) *Rat
+pkg net, type ListenConfig struct, KeepAlive time.Duration
+pkg net/http, const StatusEarlyHints = 103
+pkg net/http, const StatusEarlyHints ideal-int
+pkg net/http, type Server struct, BaseContext func(net.Listener) context.Context
+pkg net/http, type Server struct, ConnContext func(context.Context, net.Conn) context.Context
+pkg net/http, type Transport struct, ForceAttemptHTTP2 bool
+pkg os, func UserConfigDir() (string, error)
+pkg os, method (*LinkError) Unwrap() error
+pkg os, method (*PathError) Unwrap() error
+pkg os, method (*SyscallError) Unwrap() error
+pkg os, var ErrTimeout error
+pkg os/exec, method (*Cmd) String() string
+pkg reflect, method (Value) IsZero() bool
+pkg syscall, method (Errno) Is(error) bool
+pkg testing, method (*B) ReportMetric(float64, string)
+pkg testing, type BenchmarkResult struct, Extra map[string]float64
+pkg time, method (Duration) Microseconds() int64
+pkg time, method (Duration) Milliseconds() int64
2019/04/18 18:53:32 FAILED
2019/04/19 00:53:32 remote failure running src/all.rc: exit status: 'all.rc 148: go 3753: 1'
2019/04/19 00:53:32 done.
2019/04/19 00:53:33 SERIAL: 2019/04/18 18:53:32 [0x10c629a0] Run = exit status: 'all.rc 148: go 3753: 1', after 1h33m7.743124491s
                            2019/04/18 18:53:32 Halting in 1 second.
2019/04/19 00:53:33 SERIAL: 2019/04/18 18:53:33 Halting machine.
exit status 1

@0intro
Copy link
Member

0intro commented Apr 19, 2019

I ran the plan9/386 build in debugnewvm during the whole night and the test always completed successfully (except issue30908).

I am using:

@bradfitz
Copy link
Contributor Author

debugnewvm doesn't quite do what the coordinator does, either. It's much closer and is useful for debugging, but it's not 100% the same (yet?). It still runs all.rc instead of running each test separately. I wonder if that's related. I can't think of anything else.

@0intro
Copy link
Member

0intro commented Apr 19, 2019

I'm unfamiliar with the coordinator internals. How difficult would it be to change debugnewvm to run the tests separately and behave closer to the coordinator?

@0intro
Copy link
Member

0intro commented May 7, 2019

@bradfitz Would it be possible to send me a builder key for another plan9/386 builder, so I could run the buildlet on my side?

@bradfitz
Copy link
Contributor Author

bradfitz commented May 9, 2019

@0intro, sure, send a CL to dashboard/builders.go adding the new host type & builder (host-plan9-386-0intro and plan9-386-0intro) and I'll send you the host key.

@gopherbot
Copy link

Change https://golang.org/cl/175901 mentions this issue: dashboard: add plan9-386-0intro builder

gopherbot pushed a commit to golang/build that referenced this issue May 9, 2019
This change adds the plan9-386-0intro builder
configuration.

Updates golang/go#29801.

Change-Id: I5f64f4592a499eb1691498805fd0dfa5082c33d5
Reviewed-on: https://go-review.googlesource.com/c/build/+/175901
Run-TryBot: David du Colombier <0intro@gmail.com>
TryBot-Result: Gobot Gobot <gobot@golang.org>
Reviewed-by: Brad Fitzpatrick <bradfitz@golang.org>
@gopherbot
Copy link

Change https://go.dev/cl/408698 mentions this issue: dashboard: add known issues for plan9-386, plan9-386-0intro, and plan9-amd64-0intro

gopherbot pushed a commit to golang/build that referenced this issue May 26, 2022
…9-amd64-0intro

For golang/go#52653.
Updates golang/go#29801.
Updates golang/go#49756.
Updates golang/go#50137.

Change-Id: Ided04da5c1e403c4a194c8c645c5179534a00907
Reviewed-on: https://go-review.googlesource.com/c/build/+/408698
TryBot-Result: Gopher Robot <gobot@golang.org>
Run-TryBot: Bryan Mills <bcmills@google.com>
Reviewed-by: Alex Rakoczy <alex@golang.org>
Auto-Submit: Bryan Mills <bcmills@google.com>
@0intro
Copy link
Member

0intro commented Jun 3, 2022

@golang/release I propose we try to re-enable the plan9/386 builder on GCE.

I will be able to provide:

  • an up-to-date Plan 9 image
  • an up-to-date buildlet binary for plan9/386
  • an up-to-date Go bootstrap for plan9/386

@dmitshur dmitshur added NeedsDecision Feedback is required from experts, contributors, and/or the community before a change can be made. and removed NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. labels Jun 7, 2022
@dmitshur dmitshur added this to Planned in Go Release Team Jun 7, 2022
@heschi
Copy link
Contributor

heschi commented Jun 15, 2022

I think we're waiting for #53383 to be resolved so we have some level of clarity on secondary ports.

@dmitshur dmitshur added NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. and removed NeedsDecision Feedback is required from experts, contributors, and/or the community before a change can be made. labels Jun 23, 2022
@bcmills
Copy link
Contributor

bcmills commented Nov 3, 2022

I think we're waiting for #53383 to be resolved so we have some level of clarity on secondary ports.

That proposal has been accepted, and to my knowledge the gomote auth situation is now stable too. Can we make a decision about how to move forward with the plan9/386 builders?

@heschi
Copy link
Contributor

heschi commented Nov 3, 2022

We can spend some time giving it a shot. Ideally we would get a script we can use to create the image but we can settle for something that works for the moment.

@0intro
Copy link
Member

0intro commented Nov 4, 2022

Here are:

I will submit a change to update the make.bash script, to take into account the update of the Plan 9 ISO image from 2018-11-30 to 2022-08-08.

@heschi
Copy link
Contributor

heschi commented Nov 4, 2022

I have some time to work on this today. Ideally I'd like to produce the image, buildlet, and bootstrap myself; did you do anything special?

@heschi
Copy link
Contributor

heschi commented Nov 4, 2022

It looks like the bootstrap archive and buildlet were rebuilt when we bumped the bootstrap version requirement to 1.17. I'll try to use those versions.

@0intro
Copy link
Member

0intro commented Nov 4, 2022

I have some time to work on this today. Ideally I'd like to produce the image, buildlet, and bootstrap myself; did you do anything special?

To produce the image, you just have to run make.bash after updating the ISO image date. You also have to update the SHA1 file.

To produce the buildlet and bootstrap, I'm running personal scripts to cross-compile them automatically from Linux. I can share them if you want.

@0intro
Copy link
Member

0intro commented Nov 4, 2022

It looks like the bootstrap archive and buildlet were rebuilt when we bumped the bootstrap version requirement to 1.17. I'll try to use those versions.

It should work, but beware they seem a bit old. My latest builds are the most up-to-date.

@heschi
Copy link
Contributor

heschi commented Nov 4, 2022

This is a very, very slow builder -- it's been running for over an hour now and it's not done. Is there something that can be done to speed it up? I'm not sure we want to spend our GCE quota on this.

@0intro
Copy link
Member

0intro commented Nov 4, 2022

The disk I/O are very slow on GCE, especially on Plan 9. You should make sure the build (and GOCACHE) is done inside /tmp, which is served by the ramfs (in-memory) file system.

@heschi
Copy link
Contributor

heschi commented Nov 4, 2022

According to the comments in the buildlet, that's true by default. Any other ideas? It looks like there's an attempt to skip the cmd/go tests, which definitely were the slowest single step I saw.

@0intro
Copy link
Member

0intro commented Nov 4, 2022

Yes, we are currently skipping the cmd/go tests on the 386 and amd64 builders, to save a bit of time.
In the past, we were skipping the parallel runtime tests as well.

@heschi
Copy link
Contributor

heschi commented Nov 7, 2022

I see. debugnewvm probably doesn't honor those skips so maybe it'll be better running for real. I guess the only thing to do is try it out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Builders x/build issues (builders, bots, dashboards) help wanted NeedsInvestigation Someone must examine and confirm this is a valid issue and not a duplicate of an existing one. OS-Plan9
Projects
Status: Planned
Development

No branches or pull requests

6 participants