1. chroot
2. pbulk

• install (make package) libkver inside of chroot for pbulk

  cd /usr/pkgsrc/pkgtools/libkver ; 
  env PATH=/usr/pkg_bulk/bin:/usr/pkg_bulk/sbin:${PATH} bmake package-install
  

• copy two files onto outside of chroot

  sudo -s
  mkdir -p /usr/pkg_bulk/sbin
  mkdir    /usr/pkg_bulk/lib
  cp -p /CHROOT/usr/pkg_bulk/sbin/kver      /usr/pkg_bulk/sbin
  cp -p /CHROOT/usr/pkg_bulk/lib/libkber.so /usr/pkg_bulk/lib
  

  without doing above, you may got

  /usr/pkg/lib/libkver.so not found
  
  
  (after you once run pbulk)
  

/usr/pkg_bulk/sbin/kver -r 9.3 /usr/sbin/chroot /CHROOT

env SHELL=/usr/pkg_bulk/bin/zsh  /usr/pkg_bulk/sbin/kver -r 9.3 /usr/sbin/chroot /CHROOT

sx2-252@makoto 11:27:38/230520(~)% sudo sh   /CHROOT/chroot-9.3.sh 
Password: 

sx2-252# uname -a
NetBSD sx2-252.s.ki.nu 9.3 NetBSD 9.3 (LIBKVER) #0: 
  Tue Jan 19 00:00:00 UTC 2038 root@localhost:/sys/arch/amd64/compile/LIBKVER amd64

SX2@makoto 08:32:30/230507(..git-work/netbsd-src)% git pull
warning: redirecting to https://github.com/IIJ-NetBSD/netbsd-src/
remote: Enumerating objects: 205208, done.
remote: Counting objects: 100% (75260/75260), done.
remote: Compressing objects: 100% (1062/1062), done.
remote: Total 205208 (delta 74196), reused 75241 (delta 74190), pack-reused 129948
Receiving objects: 100% (205208/205208), 278.57 MiB | 9.65 MiB/s, done.
Resolving deltas: 100% (168503/168503), completed with 19182 local objects.
From http://github.com/IIJ-NetBSD/netbsd-src
   025caf2395f..766c72c19da  master     -> origin/master
 * [new branch]              netbsd-10  -> origin/netbsd-10
   41205f1b587..a457ead2823  netbsd-6   -> origin/netbsd-6
   cbd11cbb7c7..2a5630b4849  netbsd-7   -> origin/netbsd-7
   295dbf2e9ba..f4e744ccb8b  netbsd-8   -> origin/netbsd-8
   4a25d6f57ec..925f41e229c  netbsd-9   -> origin/netbsd-9
hint: You have divergent branches and need to specify how to reconcile them.
hint: You can do so by running one of the following commands sometime before
hint: your next pull:
hint:
hint:   git config pull.rebase false  # merge
hint:   git config pull.rebase true   # rebase
hint:   git config pull.ff only       # fast-forward only
hint:
hint: You can replace "git config" with "git config --global" to set a default
hint: preference for all repositories. You can also pass --rebase, --no-rebase,
hint: or --ff-only on the command line to override the configured default per
hint: invocation.
fatal: Need to specify how to reconcile divergent branches.

SX2@makoto 08:36:40/230507(..git-work/netbsd-src)%  git config pull.rebase false

SX2@makoto 08:36:44/230507(..git-work/netbsd-src)% git pull
warning: redirecting to https://github.com/IIJ-NetBSD/netbsd-src/
Auto-merging distrib/sets/lists/tests/mi
CONFLICT (content): Merge conflict in distrib/sets/lists/tests/mi
Auto-merging share/man/man9/atomic_loadstore.9
CONFLICT (content): Merge conflict in share/man/man9/atomic_loadstore.9
Auto-merging share/man/man9/uvm_hotplug.9
CONFLICT (content): Merge conflict in share/man/man9/uvm_hotplug.9
Auto-merging usr.bin/make/unit-tests/varmod-edge.exp
CONFLICT (content): Merge conflict in usr.bin/make/unit-tests/varmod-edge.exp
Auto-merging usr.bin/make/unit-tests/varmod-edge.mk
CONFLICT (content): Merge conflict in usr.bin/make/unit-tests/varmod-edge.mk
Automatic merge failed; fix conflicts and then commit the result.

SX2@makoto 08:38:06/230507(..git-work/netbsd-src)% git branch
  8.99.28
  debug-acpi-201901
  debug-drm
  iwn-debug
* master
  mptutil
  netbsd-7
  netbsd-9
  panasonic
  sloss-toughbook
  sloss-toughbook-9
  sloss-toughbook-9.0
  sshd

SX2@makoto 08:39:25/230507(..git-work/netbsd-src)%  git config pull.rebase true

SX2@makoto 08:39:32/230507(..git-work/netbsd-src)% git merge --abort
Updating files: 100% (158700/158700), done.

SX2@makoto 08:40:37/230507(..git-work/netbsd-src)% git pull
warning: redirecting to https://github.com/IIJ-NetBSD/netbsd-src/
warning: skipped previously applied commit 1449ec34474
warning: skipped previously applied commit 1e9ad558f7b
warning: skipped previously applied commit d459f1e9bef
warning: skipped previously applied commit 8e9097a515d
warning: skipped previously applied commit 80baaac0d21
hint: use --reapply-cherry-picks to include skipped commits
hint: Disable this message with "git config advice.skippedCherryPicks false"
Successfully rebased and updated refs/heads/master.

  \\-__,------,___.
   \\        __,---`  NetBSD/x86 BIOS Boot
    \\       `---,_.  Revision 5.11 (Sat May  6 17:21:51 UTC 2023)
     \\-,_____,.---`
      \\
       \\
        \\


     1. Boot normally
     2. Boot single user
     3. Drop to boot prompt

Choose an option; RETURN for default; SPACE to stop countdown.
Option 1 will be chosen in 0 seconds.     

Option: [1]:3

userconf disable i915drmkms
boot netbsd -s

Enter pathname of shell or RETURN for /bin/sh: 
We recommend that you create a non-root account and use su(1) for root access.
# mount -a
# cd /
# cat boot.cfg
menu=Boot normally:rndseed /var/db/entropy-file;boot
menu=Boot single user:rndseed /var/db/entropy-file;boot -s
menu=Drop to boot prompt:prompt
default=1
timeout=5
clear=1
#
# export TERM=xterm
# vi /boot.cfg

menu=Boot    normally:rndseed /var/db/entropy-file;userconf disable i915drmkms; boot
menu=Boot single user:rndseed /var/db/entropy-file;userconf disable i915drmkms; boot -s
menu=Drop to boot prompt:prompt
default=1
timeout=5
clear=1

1.02419201 trap type 1 code 0 rip OXfIFTITISUM
1.02419201 curlup OxffffffFF81886580 pid 0.0 louest kstack Bb

Stopped in pid 0.0 (system) at netbsd:breakpoint+0x5: leavea
breakpoint () at netbsd:breakpoint+0x5
vpanic() at netbsd:panic+0x173 
panic() at netbsd:panic+0x3c 
extent_alloc_region() at netbsd:extent_alloc_region+0×253
bus_space_reserve() at netbsd:bus_space_reserve+0×54 
bus_space_map() at netbsd:bus_space_map+0x43
lpt_acpi_attach() at netbsd:lpt_acpi_attach+0xa7
config_attach_internal () at netbsd:config_attach_internal+0x19f 
config-found() at netbsd:config_found+Oxc3
acpi_rescan() at netbsd: acpi_rescan+0x36d 
acpi_attach () at netbsd:acpi_attach+0x44d 
config_attach_internal () at netbsd:config_attach_internal+0x19f 
config_found() at netbsd:config_found+Oxc3
amd64_mainbus_attach() at netbsd:and64_mainbus_attach+0x28c 
config_attach_internal () at netbsd:config_attach_internal+0x19f 
config_rootfound() at netbsd:config_rootfound+0x7?
cpu configure() at netbsd:cpu_configure+0x38 
main() at netbsd:main+0x32c
ds     ffff

git bisect start bad good
git bisect good
git bisect bad
git bisect skip

* 4b77a4866ad [2021-10-15 19:21:45 +0000] Convert some debug messages to aprint_debug @jmcneill
* 957ea0a8133 [2021-10-07 00:11:08 +0000] Also print the device name with aprint_naive, 
                                          like wss@pnpbios does. @uwe
* 78d045556f6 [2021-10-06 20:10:42 +0000] Don't use aprint_normal_dev("") to print the device name. @uwe
* baaa913025e [2021-10-06 18:41:34 +0000] Fix KASSERT triggered when attaching opl at wss. @uwe

localhost@makoto 18:01:11/230506(..git-work/netbsd-src)% git bisect good
0223269e93ddbb5f5587645143bfaaed9e00fab2 is the first bad commit
commit 0223269e93ddbb5f5587645143bfaaed9e00fab2
Author: jmcneill <jmcneill@netbsd.org>
Date:   Sat Oct 16 13:09:40 2021 +0000

    Enable com and lpt at ACPI attachments.

 sys/arch/amd64/conf/GENERIC | 12 ++++++++----
 1 file changed, 8 insertions(+), 4 deletions(-)

1. do as described on 2016 advent calendar
2. (say, manual installboot for -t raid)

   # installboot -fv -o console=com0,speed=115200 -t raid /dev/wd0a bootxx_ffsv2 /boot
   File system:         /dev/rwd0a                                                                 
   File system type:    raid (blocksize 16384, needswap 0)                                         
   Primary bootstrap:   bootxx_ffsv2                                                               
   Secondary bootstrap: /boot                                                                      
   Boot options:        timeout 5, flags 0, speed 115200, ioaddr 0, console com0                   
   # installboot -fv -o console=com0,speed=115200 -t raid /dev/wd1a bootxx_ffsv2 /boot
   File system:         /dev/rwd1a                                                                 
   File system type:    raid (blocksize 16384, needswap 0)                                         
   Primary bootstrap:   bootxx_ffsv2                                                               
   Secondary bootstrap: /boot                                                                      
   Boot options:        timeout 5, flags 0, speed 115200, ioaddr 0, console com0                   
   # exit
   

3. The first reboot may fail as saying cannot mount root, error = 16
   

   [   6.0764013] uhub3: single transaction translator                                
   [   6.4968109] WARNING: findroot: double match for boot device 
                  (bootinfo/bootwedge:wd0 bootinfo/bootwedge:wd1)
   [   6.5168301] raid5: RAID Level 1                                                 
   [   6.5268407] raid5: Components: /dev/wd1a /dev/wd0a                              
   [   6.5268407] raid5: Total Sectors: 159999936 (78124 MB)                          
   [   6.5568691] WARNING: 3 errors while detecting hardware; check system log.       
   [   6.5668794] boot device: wd0                                                    
   [   6.5668794] root on wd0a dumps on wd0b                                          
   [   6.5668794] vfs_mountroot: can't open root device                               
   [   6.5768887] cannot mount root, error = 16
   [   6.5768887] root device (default wd0a): raid5a
   [  16.4264490] dump device (default raid5b):
   [  17.7076926] file system (default generic):
   [  18.3483145] root on raid5a dumps on raid5b                                      
   [  18.3783460] root file system type: ffs                                          
   [  18.3783460] kern.module.path=/stand/amd64/9.3/modules                           
   [  18.3883539] kern info: [drm] Memory usable by graphics device = 2048M           
   [  18.3990870] kern info: [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).                                                                              
   [  18.4083730] kern info: [drm] Driver supports precise vblank timestamp query.    
   [  18.4083730] kern info: [drm] failed to find VBIOS tables                        
   [  18.4584207] i915drmkms0: interrupting at ioapic0 pin 16 (i915drmkms0)           
   [  18.6486087] kern info: [drm] GMBUS [i915 gmbus dpc] timed out, 
                  falling back to bit banging on pin 4                                                    
   

   but type
   raid5 (in my case) for boot device
4. raidctl -A softroot raid5
5. reboot
6. working fine