Geoffroy,
             I have attached the service VM kernel debug messages when launching the user vm with GPU passthrough. There is a kernel panic occurring and then the device reboots. I hope this will help identify the root cause. Please check the logs and reply.