OVHcloud

How to use OVH rescue mode and the IPMI KVM console

Rescue mode boots an OVH server into a temporary system over the network: from it you can copy files, check the disks or reset a password. The KVM console (IPMI) shows the server’s screen in your browser, even when its network is down.

  • Time: 15 minutes
  • Level: Intermediate

In short

  • Rescue: General information → “...” next to Boot → Edit → Boot in rescue mode → Customer rescue system, then Restart. The password arrives by email, or you log in with an SSH key.
  • Rescue mode does not erase the disks, but it does not mount them either: lsblk, then mount /dev/md3 /mnt (your device name may differ).
  • When you are done, switch back to Boot from the hard disk and reboot the server, otherwise it boots into rescue mode again.
  • KVM: the IPMI/KVM tab → Access the console (KVM). Kimsufi servers have no IPMI.
Contents
  1. Rescue or KVM: which one you need
  2. How to boot the server into rescue mode
  3. How to mount the disks and copy files
  4. How to reset a user password through rescue mode
  5. How to leave rescue mode
  6. How to open the KVM console (IPMI)
  7. OVH monitoring and technician intervention
  8. If it did not work
  9. FAQ

You will need

  • Access to the OVHcloud panel with the account the server was transferred to.
  • An SSH client and, if you like, your public SSH key: how to connect via SSH.
  • Access to your OVH account’s email if you log in to rescue mode with a password: it is sent there.

Rescue or KVM: which one you need

TaskWhat to open
The system does not boot, and you need to get files outRescue mode
You forgot a Linux user’s passwordRescue mode
Check the disks while the system is not runningRescue mode
See where the boot stopped, or an error on the screenKVM console (IPMI)
The server’s network is down, and SSH does not workKVM console (IPMI)
Install a system from your own ISO imageKVM console (IPMI)

Rescue mode and the KVM console are turned on from the server page in the OVHcloud panel: Bare Metal CloudDedicated serversyour server. OVH’s newer guides call the panel the OVHcloud Console, older ones the OVHcloud Control Panel. This guide is for dedicated servers: an OVH VPS has different buttons, and we do not cover them here.

How to boot the server into rescue mode

The server reboots, and websites and programs on it stay down until you switch back to booting from disk.

  1. Open the boot settings

    On the General information tab, find the block of the same name, click “...” next to Boot and choose Edit.

  2. Choose Boot in rescue mode and Customer rescue system

    On the Change the netboot page, choose Boot in rescue mode, and in the list, Customer rescue system. This is Linux based on Debian 12. The other options (Rescue system for Windows, iPXE and the outdated Legacy Windows rescue system) are not needed for working with a Linux server.

  3. Choose how you will log in

    There are two ways:

    • a password by email: OVH sends it to the account’s contact email or to the address in the Send new login details to the following email address field;
    • an SSH key: turn on Authentication via SSH key and choose a saved key or paste yours into the Your Public SSH key field (RSA, ECDSA and ED25519 keys work).

    Save your choice.

  4. Reboot the server

    In the Service status block, click “...” next to Status → Restart → Confirm. This is a hard reboot; it takes a few minutes, and you can follow it in the Tasks tab.

  5. Connect over SSH as root

    If you chose an SSH key in step 3, you need no password: connect with that key. If you chose password login, the password arrives by email, and a copy of the email is also in the panel: Service emails in the account menu, under the button with your initials.

    ssh root@203.0.113.10

    The command prompt shows a name like …rescue-customer-eu: that means you are in rescue mode.

Your SSH client may warn that the server’s key fingerprint does not match: rescue mode has its own key. Remove the old entry on your computer and connect again:

ssh-keygen -R 203.0.113.10

How to mount the disks and copy files

Rescue mode does not touch the server’s disks, but it does not mount them either: you mount them yourself. First, see which disks and partitions there are:

lsblk

md devices are software RAID: the system partition is usually the largest of them. If there is no RAID, look for the largest partition on the disk, such as nvme0n1p3 or sda3.

If you only need to copy files, mount the partition read-only: that way you cannot break anything by accident. Substitute your device name:

mount -o ro /dev/md3 /mnt
ls /mnt

If you see the folders etc, home and var, this is your system. Copy what you need to your computer; run this command on your computer, not on the server:

scp -r root@203.0.113.10:/mnt/var/www ./server-backup
If lsblk shows no md devices or the partition will not mount

Check the software RAID status with cat /proc/mdstat. If the arrays are not assembled, assemble them with mdadm --assemble --scan and run lsblk again. If the system is on LVM, activate the volume groups with vgchange -ay: the volumes appear in /dev/mapper/.

How to reset a user password through rescue mode

This method is for Linux. OVH has a separate guide for Windows servers, and if you cannot manage it yourself, write to us in a ticket.

  1. Mount the system partition with write access

    mount /dev/md3 /mnt

    If the partition is already mounted read-only, remount it: mount -o remount,rw /mnt.

  2. Switch into your system

    After this command, everything you type runs inside the server’s system:

    chroot /mnt/
  3. Find the user name

    ls /home

    It is usually ubuntu, debian or rocky. The full list of users is in /etc/passwd.

  4. Set a new password

    passwd ubuntu

    Enter the new password twice. The answer passwd: password updated successfully means the password has changed.

    Put the user name after passwd. Without a name, passwd changes root’s password, and root is disabled by default on OVH servers: you still will not be able to log in over SSH with that password.

  5. Rocky Linux only: refresh the SELinux labels

    On Rocky Linux and other systems with SELinux, also run this inside chroot:

    touch /.autorelabel

    Without it, SELinux may not let you log in with the new password. The first boot takes longer than usual: the system relabels its files. Ubuntu and Debian do not need this step.

  6. Leave the system and unmount the partition

    exit
    umount /mnt

    Now switch back to booting from disk, as described below, and log in as the user with the new password.

How to leave rescue mode

  1. Switch back to booting from disk

    Click “...” next to Boot → Edit again, choose Boot from the hard disk and save.

  2. Reboot the server

    Run reboot in the rescue session or click Restart in the panel.

  3. Check that your system has booted

    After a few minutes, log in over SSH as your user. The prompt shows your server’s name, not rescue-customer-eu. If SSH warns about a changed key again, run ssh-keygen -R with the server’s IP.

How to open the KVM console (IPMI)

The KVM console shows the server’s screen and passes your keyboard to it, as if you were sitting in front of it. It works independently of the server’s system, so it opens even when the server’s network is not set up.

  1. Open the IPMI/KVM tab

    On the server page, go to the IPMI/KVM tab.

  2. Start the console in your browser

    In the Via your web browser (KVM) block, click Access the console (KVM). The console opens in your browser; you do not need to install anything.

  3. Log in on the screen

    Log in as the OS user with a password. SSH keys do not work in the console, and root is disabled on OVH servers, so you cannot log in without the user’s password. Lost the password? Reset it through rescue mode.

Other methods: Java, Serial over LAN, ISO image, IPMI reset

Java applet. “From a Java applet (KVM)” downloads a kvm.jnlp file, which needs Java on your computer.

Serial over LAN is a text console. In the browser: “From your browser (SoL)”, with the fallback link “Go to console (SoL)”. Over SSH: “Add SSH key”, then “Launch SoL session via SSH”, and copy the connection address.

Installing from an ISO. In the web console, choose the image with “Browse File”, click “Start Media”, then reboot the server through the Power → Reset Server menu. OVH does not guarantee that a system installed this way works, and the installation erases the data on the disks, just like a reinstall from the panel.

If the console does not open, click Test the IPMI on the tab. If there is an error, click Reboot the IPMI: restarting the IPMI takes a few minutes and does not affect the server itself.

Which of these methods your server has depends on its hardware. More in OVH’s guide How to use the IPMI console.

Kimsufi servers have no IPMI, and on other budget OVH ranges it may be missing or limited. If there is no IPMI/KVM tab, rescue mode is what you have.

OVH monitoring and technician intervention

OVH checks the server around the clock with ping (ICMP). What happens when the server stops responding is set in the Service status block on the General information tab. There are three options:

  • Enabled with proactive intervention: OVH sends an email, and a data center technician checks the server;
  • Enabled without proactive intervention: only an email, and a technician checks the server when you ask support;
  • Disabled: no emails and no checks.

If a firewall on the server blocks ICMP, OVH concludes that the server is not responding. Allow ICMP from OVH’s monitoring addresses; the list is in the guide OVHcloud monitoring IP addresses. If your work will keep the server from answering ping for a while, OVH recommends choosing Disabled for that time. OVH does not say what exactly the technician does during a check.

If it did not work

What you seeWhat to do
After a reboot, the server is in rescue mode againBooting from disk was not restored. Choose Boot from the hard disk and reboot the server.
The email with the rescue password did not arriveCheck your spam folder and Service emails in the account menu. Or choose SSH key login and reboot the server into rescue mode again.
WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!Rescue mode has its own server key. On your computer, run ssh-keygen -R with the server’s IP.
special device /dev/md3 does not existYour device has a different name. Look it up in lsblk and use it in the command.
The IPMI console does not open, or the screen is blankClick Test the IPMI, then Reboot the IPMI. Try another method: Java or Serial over LAN.
There is no IPMI/KVM tabThis server range has no IPMI, Kimsufi for example. Use rescue mode.
The OVH panel does not openSome internet providers in some countries restrict access to provider websites. Ask us in a ticket or on Telegram to boot the server into rescue mode or reboot it.

If the server still does not respond, work through the checklist in “Server not responding” and send us what it lists. More on rescue mode in OVH’s guide How to activate and use rescue mode.

FAQ

Will rescue mode erase my data?
No. Rescue mode boots over the network and does not touch the disks. Data can change only if you write or delete something on a mounted partition yourself.
Where do I get the rescue password?
OVH emails it to the account’s contact address or to the address you entered when turning on rescue mode. A copy of the email is in the panel, under Service emails in the account menu.
Older guides mention rescue64-pro and rescue-pro. Where are they?
Those are old names. The same option is now called Customer rescue system.

Did this guide help?

Questions?