this post was submitted on 02 Aug 2024
597 points (98.5% liked)

linuxmemes

20880 readers
5 users here now

I use Arch btw


Sister communities:

Community rules

  1. Follow the site-wide rules and code of conduct
  2. Be civil
  3. Post Linux-related content
  4. No recent reposts

Please report posts and comments that break these rules!

founded 1 year ago
MODERATORS
 

It was also actually pretty fun!

top 46 comments
sorted by: hot top controversial new old
[–] [email protected] 118 points 3 months ago (2 children)

Give me more of this and less of the politics. This is what I come to Lemmy for.

[–] [email protected] 10 points 3 months ago

subscribe to the linux comms and not to the politics comms

[–] [email protected] 51 points 3 months ago* (last edited 3 months ago) (2 children)

Impressive, sounds like magic, tbh! You know any tutorials?

[–] [email protected] 87 points 3 months ago (4 children)

Not really, I pulled it together from a bunch of random posts lol

Maybe I should write one, but in essence you:

  • Stop all non-OS essential services

  • Create a filesystem in a chunk of RAM

  • Pull essential OS files from the installed OS into it recreating needed directories (Though you could probably just use a tiny pre-built distro but meh)

  • Pivot root into it

  • Reload services (when they restart they'll be restarted in the context of where you pivot rooted, prior they're still running under the context of the installed OS)

  • Unmount the boot drive

  • Then do what ever you need to do

  • ???

  • Profit

[–] [email protected] 25 points 3 months ago (2 children)

How exactly so you pivot root? Simply chroot or something more involved?

[–] [email protected] 73 points 3 months ago (2 children)

chroot isn't enough, you need "real" pivot_root

chroot just changes the shells root point, pivot_root actually changes the root mount point and enables this trick to work

[–] [email protected] 26 points 3 months ago

This is god-tier technique, kudos

[–] [email protected] 12 points 3 months ago
[–] [email protected] 15 points 3 months ago

I work in this field and I think this is 🔥 af

[–] [email protected] 6 points 3 months ago

FYI you can use kexec and a prepared initrd to do something similar with only one command.

[–] [email protected] 3 points 3 months ago

Imagining this process, despite having never done 50% of the steps on the list, makes my brain imagine this: Turning a sphere outside in

[–] [email protected] 27 points 3 months ago (1 children)

Yeah, I'd love to see a write up on this to follow.Sounds like useful practice in the lab if nothing else.

[–] [email protected] 3 points 3 months ago

i experimented with this some time ago, see my post here: https://lemmy.ml/post/18706002/12772832

[–] [email protected] 28 points 3 months ago (4 children)

What happens if the SSH session closes before dd finishes? Sounds pretty badass but I don't think I would trust this approach in prod lol

[–] [email protected] 32 points 3 months ago (1 children)

Well the 1 SSH session bit was for dramatic meme-effect lol, you can actually connect back without issue (at least it did for me) so worst case if you weren't working in tmux you'd just have to start dd again

Worst worst case, you'd just end up back where you were probably heading before anyways, KVM/IPMI

[–] [email protected] 6 points 3 months ago

Sure, I suppose as long as sshd is up and running in the ramdisk environment (which you mentioned in another comment, along with all other services) you could always reconnect. Very neat and clever!

[–] [email protected] 10 points 3 months ago (1 children)

You could use screen or tmux for a persistent terminal session.

[–] [email protected] 11 points 3 months ago

True, but I was more thinking about the issue of reconnecting in general when you just nuked sshd.

[–] [email protected] 2 points 3 months ago

As long as you only copy off the disk, you can just reboot and the whole system in RAM vanishes and the normal system boots again for the second try.

[–] [email protected] 1 points 3 months ago

Maybe run ssh on 2 different ports?

[–] [email protected] 24 points 3 months ago

I also vote for a writeup. This sounds awesome!

[–] [email protected] 21 points 3 months ago (2 children)

Can someone ELI5? Are you freefloating an operating system on your RAM?

[–] [email protected] 36 points 3 months ago (1 children)

I had a server I rented from a provider in a data center and I wanted to image (dd) the drive for archival before I decommissioned it from my infrastructure.

Normally, you can't really do that with the OS running and you would have to shut down and insert a live USB or something and temporarily boot from that. The server being a faraway rental the only option was to open a ticket so that they could enable an out-of-band management option like KVM or IPMI. Which would allow you to control a machine as if you had a physical monitor, keyboard and mouse in front of you. With that you can attach flash drives, shutdown, restart, see the POST/BIOS/UEFI screens etc remotely .

But, I didn't want to wait 6-8 hours for them to enable that so instead I put together a process that would "boot" me into another distro "installed" into a RAM disk (kinda like how live CD/USB works) from the currently installed and running OS without rebooting

From there I could unmount the boot disk and do what ever I wanted from there, I could have even wiped the disk entirely and installed a entirely different distro if I wanted

[–] [email protected] 10 points 3 months ago

How do you do that? What minimal distro did you use? Did you make it yourself? How reliable is pivot-root? How many tries did it take you to do that successfully?

[–] [email protected] 17 points 3 months ago

RAM is still memory, so you can put anything in there, like an OS.

With pivot_root, you can change where the root is. So you pivot into your OS in RAM, which becomes the root of the system.

At that point, you can do pretty much anything you would normally do with your OS, like unmount a HDD.

I've never personally done it, but that's a simplified explanation of what OP did.

[–] [email protected] 19 points 3 months ago

I did this once to install a different distro on a free oracle VPS lol

[–] [email protected] 14 points 3 months ago* (last edited 3 months ago) (1 children)

Hopefully you don’t lose power or something else bad happens or there goes your data

[–] [email protected] 5 points 3 months ago

If that happens, they just fall back to the first option of waiting for their provider to set up the IPMI.

[–] [email protected] 12 points 3 months ago (1 children)

I've never gotten pivot_root to work well / as documented. Major props for being able to pull this off. Hopefully you didn't have much time where a connection-drop would require a reboot. SSH in the new root on an alternate port before the pivot? idk.

[–] [email protected] 8 points 3 months ago (1 children)

Really? It seemed to go pretty smooth for me, SSH dropped once I think when I reloaded the services (expected), but after that I was able to connect back fine on the same port no issue

[–] [email protected] 1 points 3 months ago

It's been a LONG time since I tried, but ISTR it complaining that it couldn't move the old_root because it was in use? But, when I'd fuser it, the only think that was using it was my shell (using it as the current directory).

[–] [email protected] 11 points 3 months ago (1 children)

read this over on Linux community a few days ago

https://cloudbsd.xyz/

[–] [email protected] 5 points 3 months ago

Damn lol wish I would have come out sooner lmao Seems a tad more complicated though, I don't remember having to compile anything at least

[–] [email protected] 9 points 3 months ago

@cm0002
I need that!

Is there a tutorial for that? I have an Old outdated Synology nas that I wish to replace the system with an Open Media Vault.

[–] [email protected] 7 points 3 months ago

Check out dattobd sometime. It's a tool that allows you to make a snapshot of a block device for backups, while the OS is running. Useful if your filesystem doesn't support snapshots.

[–] [email protected] 6 points 3 months ago* (last edited 3 months ago) (2 children)

I’ve been killing myself in my free time to get a NanoPi R6S to boot from an SD card; wish I had this expertise.

Edit: I didn’t say this very clearly, I’ve been killing myself to build and compile U-Boot, the Linux kernel then building an image to write to an SD card that’ll actually boot.

[–] [email protected] 7 points 3 months ago (1 children)

Heh, this expertise is built on hundreds of "Why tf won't X boot from Y!!" and solid research skills lol you'll get there

[–] [email protected] 1 points 3 months ago

Oops, I realize now that my comment made it seem like I can’t figure out how to write an image to external media and boot it properly. It was actually more intense than that, so I’ve updated it.

[–] [email protected] 2 points 3 months ago (1 children)

Not sure about your hardware, but try to look up if it requires a special kernel, like the RPi 5 (which only runs on raspbian because they ship that kernel)

[–] [email protected] 1 points 3 months ago

The manufacturer ships several tools but a lot of the necessary files are shared from Google Drive, and each time I try to download one it says “download limit exceeded.” My goal is to build something more vanilla — I can see that the hardware is supported in the mainline kernel so I’m doing this with tons of trial and error (which I don’t mind).

I’m doing everything in a Dockerfile so once I’m there the goal is to clean it up and push it to GitHub.

[–] [email protected] 4 points 3 months ago

Once I figured out how to netboot the os into memory that's how I run all my nodes :)

[–] [email protected] 4 points 3 months ago* (last edited 3 months ago)

i had experimented with kexec and takeover.sh to install a distro that was not available by my provider.

it resulted in some scripts i now (triggered by this thread) have published (in a nonready state):

http://github.com/tobinq/goaround

the scripts may be in bad shape but i successfully changed one preinstalled ubuntu to a devuan with what is in these scripts. however i didn't work on them for month now and am not sure about that last state.. so its experimental only.

[–] [email protected] 2 points 3 months ago

I have never gotten it to work. It always implodes