-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and SATA SSD
drive. I have Clear Linux 25130 installed on the SSD (SATA). There are a
number of partitions on the NVMe drive but I'm not using any of those at the
moment. I have observed that the ACRN hypervisor does not start correctly
when the NVMe drive is installed. I don't know exactly what is happening
since I don't have a serial cable hooked up to it but I never see the Clear
Linux bootloader coming up. As soon as I physically remove the NVMe drive,
I can see that bootloader (the Service OS is not coming up but I am treating
this as a different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-kits/nuc/kits/
nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and reply later.


Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy Van
Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and SATA SSD
drive. I have Clear Linux 25130 installed on the SSD (SATA). There are
a number of partitions on the NVMe drive but I'm not using any of
those at the moment. I have observed that the ACRN hypervisor does not
start correctly when the NVMe drive is installed. I don't know exactly
what is happening since I don't have a serial cable hooked up to it
but I never see the Clear Linux bootloader coming up. As soon as I
physically remove the NVMe drive, I can see that bootloader (the
Service OS is not coming up but I am treating this as a different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot order is under
the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot the next item in
boot order list.

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and reply later.


Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy Van
Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and SATA
SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not using
any of those at the moment. I have observed that the ACRN hypervisor
does not start correctly when the NVMe drive is installed. I don't
know exactly what is happening since I don't have a serial cable
hooked up to it but I never see the Clear Linux bootloader coming
up. As soon as I physically remove the NVMe drive, I can see that
bootloader (the Service OS is not coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot order is under
the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot the
next item in boot order list.

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and reply later.


Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy
Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and SATA
SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the ACRN
hypervisor does not start correctly when the NVMe drive is
installed. I don't know exactly what is happening since I don't
have a serial cable hooked up to it but I never see the Clear
Linux bootloader coming up. As soon as I physically remove the
NVMe drive, I can see that bootloader (the Service OS is not
coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L "ACRN
Hypervisor"

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot order is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot the
next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi first, but then
nothing happens. I do not see the Clear Linux bootloader menu (from
systemd-boot). As soon as I physically remove the NVMe drive, it loads
acrn.efi and shows the Clear Linux bootloader. I'm able to bring the Service
OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ), with Ubuntu
16.04 installed on the NVMe device (so different than the first system I was
testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069) but I still see
the problem.

Note that the watchdog timer does not seem to work here, and even if it did,
it wouldn't help me too much as my objective is to actually boot ACRN (so
moving on to a next boot entry that wouldn't load ACRN does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and reply later.


Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy
Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and SATA
SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the ACRN
hypervisor does not start correctly when the NVMe drive is
installed. I don't know exactly what is happening since I don't
have a serial cable hooked up to it but I never see the Clear
Linux bootloader coming up. As soon as I physically remove the
NVMe drive, I can see that bootloader (the Service OS is not
coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L "ACRN
Hypervisor"

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot order
is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot the
next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi first,
but then nothing happens. I do not see the Clear Linux bootloader menu
(from systemd-boot). As soon as I physically remove the NVMe drive, it
loads acrn.efi and shows the Clear Linux bootloader. I'm able to bring
the Service OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ), with
Ubuntu
16.04 installed on the NVMe device (so different than the first system
I was testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069) but I
still see the problem.

Note that the watchdog timer does not seem to work here, and even if
it did, it wouldn't help me too much as my objective is to actually
boot ACRN (so moving on to a next boot entry that wouldn't load ACRN does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and reply later.


Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy
Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and
SATA SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the ACRN
hypervisor does not start correctly when the NVMe drive is
installed. I don't know exactly what is happening since I don't
have a serial cable hooked up to it but I never see the Clear
Linux bootloader coming up. As soon as I physically remove the
NVMe drive, I can see that bootloader (the Service OS is not
coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 4:45 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

I tested with proper -d parameter, it can boot up from NVME on the system
with both NVMe and SATA disk installed, without any additional ACRN
patches.

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:13
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L "ACRN
Hypervisor"

I was not even trying to boot from the NVMe device yet, it's on my wishlist
though. Should that work?

Minxia reproduced the issue I'm facing and it has to do with the bus ID being
higher than 0xF. I've just tested a patched acrn.efi and it worked on my
system :-)

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot order
is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot the
next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi first,
but then nothing happens. I do not see the Clear Linux bootloader menu
(from systemd-boot). As soon as I physically remove the NVMe drive, it
loads acrn.efi and shows the Clear Linux bootloader. I'm able to bring
the Service OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ), with
Ubuntu
16.04 installed on the NVMe device (so different than the first system
I was testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069) but I
still see the problem.

Note that the watchdog timer does not seem to work here, and even if
it did, it wouldn't help me too much as my objective is to actually
boot ACRN (so moving on to a next boot entry that wouldn't load ACRN

does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and reply

later.

Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of Geoffroy
Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and
SATA SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the ACRN
hypervisor does not start correctly when the NVMe drive is
installed. I don't know exactly what is happening since I don't
have a serial cable hooked up to it but I never see the Clear
Linux bootloader coming up. As soon as I physically remove the
NVMe drive, I can see that bootloader (the Service OS is not
coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 4:45 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

I tested with proper -d parameter, it can boot up from NVME on the
system with both NVMe and SATA disk installed, without any additional
ACRN patches.

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:13
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L
"ACRN Hypervisor"

I was not even trying to boot from the NVMe device yet, it's on my
wishlist though. Should that work?

Minxia reproduced the issue I'm facing and it has to do with the bus
ID being higher than 0xF. I've just tested a patched acrn.efi and it
worked on my system :-)

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot
order is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot
the next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi first,
but then nothing happens. I do not see the Clear Linux bootloader
menu (from systemd-boot). As soon as I physically remove the NVMe
drive, it loads acrn.efi and shows the Clear Linux bootloader. I'm
able to bring the Service OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ), with
Ubuntu
16.04 installed on the NVMe device (so different than the first
system I was testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069) but
I still see the problem.

Note that the watchdog timer does not seem to work here, and even if
it did, it wouldn't help me too much as my objective is to actually
boot ACRN (so moving on to a next boot entry that wouldn't load ACRN

does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and
reply

later.

Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of
Geoffroy Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and
SATA SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the
ACRN hypervisor does not start correctly when the NVMe drive
is installed. I don't know exactly what is happening since I
don't have a serial cable hooked up to it but I never see the
Clear Linux bootloader coming up. As soon as I physically
remove the NVMe drive, I can see that bootloader (the Service
OS is not coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 4:45 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

I tested with proper -d parameter, it can boot up from NVME on the
system with both NVMe and SATA disk installed, without any additional
ACRN patches.

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:13
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L
"ACRN Hypervisor"

I was not even trying to boot from the NVMe device yet, it's on my
wishlist though. Should that work?

Minxia reproduced the issue I'm facing and it has to do with the bus
ID being higher than 0xF. I've just tested a patched acrn.efi and it
worked on my system :-)

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot
order is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the first
boot item didn't call exit-boot-service, BIOS will try to boot
the next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi first,
but then nothing happens. I do not see the Clear Linux bootloader
menu (from systemd-boot). As soon as I physically remove the NVMe
drive, it loads acrn.efi and shows the Clear Linux bootloader. I'm
able to bring the Service OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ), with
Ubuntu
16.04 installed on the NVMe device (so different than the first
system I was testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069) but
I still see the problem.

Note that the watchdog timer does not seem to work here, and even if
it did, it wouldn't help me too much as my objective is to actually
boot ACRN (so moving on to a next boot entry that wouldn't load ACRN

does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and
reply

later.

Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of
Geoffroy Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and
SATA SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the
ACRN hypervisor does not start correctly when the NVMe drive
is installed. I don't know exactly what is happening since I
don't have a serial cable hooked up to it but I never see the
Clear Linux bootloader coming up. As soon as I physically
remove the NVMe drive, I can see that bootloader (the Service
OS is not coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 5:13 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Okay, I didn't see that issue because my bus ID is 2, less than 0xF.

We will submit a patch to fix it.

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 22:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

That is my PCI info:

00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core
Processor Host Bridge/DRAM Registers (rev 08)
00:02.0 VGA compatible controller: Intel Corporation UHD Graphics 620 (rev
07)
00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5
/ 6th/7th Gen Core Processor Gaussian Mixture Model
00:14.0 USB controller: Intel Corporation Sunrise Point-LP USB 3.0 xHCI
Controller (rev 21)
00:14.2 Signal processing controller: Intel Corporation Sunrise Point-LP
Thermal subsystem (rev 21)
00:15.0 Signal processing controller: Intel Corporation Sunrise Point-LP Serial
IO I2C Controller #0 (rev 21)
00:15.1 Signal processing controller: Intel Corporation Sunrise Point-LP Serial
IO I2C Controller #1 (rev 21)
00:16.0 Communication controller: Intel Corporation Sunrise Point-LP CSME
HECI #1 (rev 21)
00:16.3 Serial controller: Intel Corporation Device 9d3d (rev 21)
00:17.0 SATA controller: Intel Corporation Sunrise Point-LP SATA Controller
[AHCI mode] (rev 21)
00:1c.0 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port
#3 (rev f1)
00:1d.0 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express Root Port
#9 (rev f1)
00:1f.0 ISA bridge: Intel Corporation Intel(R) 100 Series Chipset Family LPC
Controller/eSPI Controller - 9D4E (rev 21)
00:1f.2 Memory controller: Intel Corporation Sunrise Point-LP PMC (rev 21)
00:1f.3 Audio device: Intel Corporation Sunrise Point-LP HD Audio (rev 21)
00:1f.4 SMBus: Intel Corporation Sunrise Point-LP SMBus (rev 21)
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection I219-LM
(rev 21)
01:00.0 Network controller: Intel Corporation Wireless 8265 / 8275 (rev 78)
02:00.0 Non-Volatile memory controller: Intel Corporation SSD Pro
7600p/760p/E 6100p Series (rev 03)
--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:51
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 4:45 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

I tested with proper -d parameter, it can boot up from NVME on the
system with both NVMe and SATA disk installed, without any additional
ACRN patches.

What's the bus ID of the NVMe drive on your system?

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:13
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L
"ACRN Hypervisor"

I was not even trying to boot from the NVMe device yet, it's on my
wishlist though. Should that work?

Minxia reproduced the issue I'm facing and it has to do with the bus
ID being higher than 0xF. I've just tested a patched acrn.efi and it
worked on my system :-)

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot
order is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the

first

boot item didn't call exit-boot-service, BIOS will try to boot
the next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi first,
but then nothing happens. I do not see the Clear Linux bootloader
menu (from systemd-boot). As soon as I physically remove the NVMe
drive, it loads acrn.efi and shows the Clear Linux bootloader. I'm
able to bring the Service OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ), with
Ubuntu
16.04 installed on the NVMe device (so different than the first
system I was testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069) but
I still see the problem.

Note that the watchdog timer does not seem to work here, and even if
it did, it wouldn't help me too much as my objective is to actually
boot ACRN (so moving on to a next boot entry that wouldn't load ACRN

does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and
reply

later.

Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of
Geoffroy Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and
SATA SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm not
using any of those at the moment. I have observed that the
ACRN hypervisor does not start correctly when the NVMe drive
is installed. I don't know exactly what is happening since I
don't have a serial cable hooked up to it but I never see the
Clear Linux bootloader coming up. As soon as I physically
remove the NVMe drive, I can see that bootloader (the Service
OS is not coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 5:13 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Okay, I didn't see that issue because my bus ID is 2, less than 0xF.

We will submit a patch to fix it.

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 22:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

That is my PCI info:

00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v6/7th Gen Core
Processor Host Bridge/DRAM Registers (rev 08)
00:02.0 VGA compatible controller: Intel Corporation UHD Graphics 620
(rev
07)
00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 /
E3-1500 v5 / 6th/7th Gen Core Processor Gaussian Mixture Model
00:14.0 USB controller: Intel Corporation Sunrise Point-LP USB 3.0
xHCI Controller (rev 21)
00:14.2 Signal processing controller: Intel Corporation Sunrise
Point-LP Thermal subsystem (rev 21)
00:15.0 Signal processing controller: Intel Corporation Sunrise
Point-LP Serial IO I2C Controller #0 (rev 21)
00:15.1 Signal processing controller: Intel Corporation Sunrise
Point-LP Serial IO I2C Controller #1 (rev 21)
00:16.0 Communication controller: Intel Corporation Sunrise Point-LP
CSME HECI #1 (rev 21)
00:16.3 Serial controller: Intel Corporation Device 9d3d (rev 21)
00:17.0 SATA controller: Intel Corporation Sunrise Point-LP SATA
Controller [AHCI mode] (rev 21)
00:1c.0 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express
Root Port
#3 (rev f1)
00:1d.0 PCI bridge: Intel Corporation Sunrise Point-LP PCI Express
Root Port
#9 (rev f1)
00:1f.0 ISA bridge: Intel Corporation Intel(R) 100 Series Chipset
Family LPC Controller/eSPI Controller - 9D4E (rev 21)
00:1f.2 Memory controller: Intel Corporation Sunrise Point-LP PMC (rev
21)
00:1f.3 Audio device: Intel Corporation Sunrise Point-LP HD Audio (rev
21)
00:1f.4 SMBus: Intel Corporation Sunrise Point-LP SMBus (rev 21)
00:1f.6 Ethernet controller: Intel Corporation Ethernet Connection
I219-LM (rev 21)
01:00.0 Network controller: Intel Corporation Wireless 8265 / 8275
(rev 78)
02:00.0 Non-Volatile memory controller: Intel Corporation SSD Pro
7600p/760p/E 6100p Series (rev 03)
--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:51
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 4:45 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

I tested with proper -d parameter, it can boot up from NVME on the
system with both NVMe and SATA disk installed, without any
additional ACRN patches.

What's the bus ID of the NVMe drive on your system?

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 22:13
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Jack Ren
Sent: Wednesday, September 26, 2018 3:08 PM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

Or:
Did you specify the parameter "-d" when running efibootmgr?

For example: To boot up from NVMe, we need to use:
efibootmgr -c -l "\EFI\acrn\acrn.rt.efi" -d /dev/nvme0n1 -p 1 -L
"ACRN Hypervisor"

I was not even trying to boot from the NVMe device yet, it's on my
wishlist though. Should that work?

Minxia reproduced the issue I'm facing and it has to do with the bus
ID being higher than 0xF. I've just tested a patched acrn.efi and it
worked on my system :-)

--
Best regards,
Jack Ren


-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Geoffroy Van Cutsem
Sent: Wednesday, September 26, 2018 19:56
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Chaohong guo
Sent: Wednesday, September 26, 2018 5:49 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN


Do u check the boot order in UEFI BIOS ? Generally, the boot
order is

under

the control of BIOS. UEFI bios should have a watchdog timer, if the

first

boot item didn't call exit-boot-service, BIOS will try to boot
the next item in boot order list.

The boot order in the Bios is correct, i.e. it loads acrn.efi
first, but then nothing happens. I do not see the Clear Linux
bootloader menu (from systemd-boot). As soon as I physically
remove the NVMe drive, it loads acrn.efi and shows the Clear Linux
bootloader. I'm able to bring the Service OS up after that.

I have tried on a different machine (same family, NUC7i7BNKQ),
with Ubuntu
16.04 installed on the NVMe device (so different than the first
system I was testing with) and I see the same problem.

I have upgraded both machines to the latest Bios (version 0069)
but I still see the problem.

Note that the watchdog timer does not seem to work here, and even
if it did, it wouldn't help me too much as my objective is to
actually boot ACRN (so moving on to a next boot entry that
wouldn't load ACRN

does not help me).

Thanks,
Geoffroy

-Chaohong

-----Original Message-----
From: acrn-users@... [mailto:acrn-
users@...] On Behalf Of Wang, Hongbo
Sent: Wednesday, September 26, 2018 9:45 AM
To: acrn-users@...
Subject: Re: [acrn-users] Support for NVMe drives in ACRN

We haven't tried such combination before, will have a try and
reply

later.

Best regards.
Hongbo
Tel: +86-21-6116 7445
MP: +86-1364 1793 689
Mail: hongbo.wang@...

-----Original Message-----
From: acrn-users@...
[mailto:acrn-users@...] On Behalf Of
Geoffroy Van Cutsem
Sent: Tuesday, September 25, 2018 11:42 PM
To: acrn-users@...
Subject: [acrn-users] Support for NVMe drives in ACRN

Hi folks,

I have a NUC7i7BNH [1] that is equipped with both a NVMe and
SATA SSD drive. I have Clear Linux 25130 installed on the SSD (SATA).
There are a number of partitions on the NVMe drive but I'm
not using any of those at the moment. I have observed that
the ACRN hypervisor does not start correctly when the NVMe
drive is installed. I don't know exactly what is happening
since I don't have a serial cable hooked up to it but I
never see the Clear Linux bootloader coming up. As soon as I
physically remove the NVMe drive, I can see that bootloader
(the Service OS is not coming up but I am treating this as a

different problem).

Is this a known issue?

Geoffroy

[1]
https://www.intel.com/content/www/us/en/products/boards-

kits/nuc/kits/

nuc7i7bnh.html