this post was submitted on 02 Sep 2023
382 points (98.5% liked)

Linux

48390 readers
707 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
382
ZRAM is insane (www.kernel.org)
submitted 1 year ago* (last edited 1 year ago) by [email protected] to c/[email protected]
 

I got a cheap netbook style laptop for traveling some weeks ago (HP Stream 11" with 4 GB of RAM and a N4120). Didn't expect much more from this hardware than opening a few browser tabs and doing some retro gaming via Steam.

Shared RAM with graphics card means that 3.64 GB of RAM are effectively usable for the OS. This was even too little RAM to open a handful of tabs w/o having tabs being unresponsive for seconds sometimes in a very annoying way. Another thing which made trouble was the Wifi - I guess it went into power saving, was swapped and didn't load fast enough to provide a good experience. (Of course I wasted an hour checking for Wifi drivers/support.)

In short: Even for my low expectations for this laptop it was an underwhelming experience.

First step was to look at my vm.swappiness and set it to 10, which already helped, but still the machine had hiccups and annoying timeouts.

In a last, desperate effort I enabled ZRAM on the laptop... and literally WTF: Saying it is a night and day difference doesn't do the experience justice. Typing this words now on the Stream, which I use exactly the same way as my much more beefy other machines (my next worst computer has 8G of RAM and an Intel Core i3), browsing with 10 open tabs, e-mail client open on another virtual desktop... it is crazy, it makes the Stream fun to use and I use it at home for everything which isn't heavily CPU/IO bound.

What surprised me the most: No hiccups, no timeouts and it even fixed the Wifi issues on this little machine. Didn't expect this would be possible, especially with a N4120 and 3.64 GB of RAM.

In short, my laptop changed from not even reaching my low/realistic expectations to being my favorite technical purchase of the last years, thanks to ZRAM.

Besides making this a ZRAM appreciation post, I really want to spread the word about it. Especially for old hardware and limited RAM situations, IMHO it should be the first thing which comes to mind/is recommended.

Fedora and PopOS use it by default, so it is well tested and should IMHO again, be a default at least for desktop setups.

Give it a try - supposedly it even improved the experience on much more beefy computers for gaming etc.

top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 81 points 1 year ago* (last edited 1 year ago) (2 children)

[This comment has been deleted by an automated system]

[–] [email protected] 28 points 1 year ago (1 children)

Thanks, great input.

I totally agree - ZRAM isn't magic and of course it will fall flat on its face for loads of encrypted, compressed or pure random data. In my limited day to day usage I just never hit that situation, so far.

Again, I fully agree, I wouldn't have expected that the N4120 works so well with ZRAM. For work I am forced to use a recent mac with loads of RAM. When just browsing the web/checking emails I don't feel any noticeable difference between the mac and the Stream for the CPU. (Of course, CPU/IO bound tasks are another story, and the display of the mac is in another league.) Usually I would consider myself to be quite sensitive to speed, I notice a real difference between using Gnome (with impatience etc. extensions) and Xfce, concerning the responsiveness of my desktop.

I'll check the BIOS settings, I expect the same as you. Not sure, if I will lower the reserved RAM for the iGPU, everything works fine at the moment and I want to try some light gaming on this machine.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

I'm not going to remember the right terminology, but you can also configure it with a chunk of disk to stick files that it can't compress into so they don't end up clogging up your swapspace.

[–] [email protected] 2 points 1 year ago (1 children)

Not sure if you are referring to ZSWAP, which is backed by physical swap and writes uncompressable pages to the physical swap. ZRAM has AFAIK an option called WRITEBACK, which allows it to also use physical swap, but I didn't find that ZRAM is concerned if it can compress the page or not. (Grain of salt and if someone is more knowledgeable I happily be corrected.)

[–] [email protected] 4 points 1 year ago* (last edited 1 year ago) (5 children)

I'm talking about ZRAM and I did mean writeback.

"With CONFIG_ZRAM_WRITEBACK, zram can write idle/incompressible page to backing storage rather than keeping it in memory."

From https://www.kernel.org/doc/html/latest/admin-guide/blockdev/zram.html

load more comments (5 replies)
[–] [email protected] 8 points 1 year ago

Programs shouldn't get confused since RAM/swap is transparent for them.

[–] [email protected] 44 points 1 year ago (3 children)

Anyone know of an eli5 on zram? I don't see why just compressing your RAM would make it run better.

[–] Still 38 points 1 year ago

stops having to swap pages to disk, slightly more overhead on the CPU side but for most systems that will be an order of magnitude faster that swapping to disk

[–] [email protected] 29 points 1 year ago

Let me give it a try:

Imagine you are having breakfast and sitting on your breakfast table. Everything on your table and reachable w/o getting up is what your CPU holds in its register. When you need something from the fridge in your home, this is your RAM. If you need something that is not in your fridge, you have to get dressed, get out of our home, walk to the groceries store which is half an hour away, find what you are looking for, pay for it, walk home for around half an our, switch back to your relaxed clothing and finally you can continue your breakfast. The groceries store is your hard disk/ssd whatever. With compression, imagine you have a big second fridge in the basement (or the house next to yours, you get the idea). Not as good as having stuff on your table or in your fridge, but usually at least an order of magnitude better than having to visit the groceries store.

[–] [email protected] 28 points 1 year ago

Turns out usually a significant amount of RAM is compressible. I was surprised at it too, and actually still am. But of course it also depends on how you use your system. If you run a media player that caches a lot to RAM, its cache wont be compressible, but they say its efficient for example for memory of web browsers.

[–] [email protected] 37 points 1 year ago (1 children)

I'm running ZRAM on my old Netgear ReadyNAS's, which has 512MB or 256MB RAM. It enables them to do a lot more than they otherwise would be able to, running a modern linux distribution.

I've been so satisfied with it that I even started running it on my modern desktop with 32GB RAM, it helps with my tab addiction :)

[–] [email protected] 20 points 1 year ago (5 children)

Rolling out ZRAM to all my boxes right now! 🙃

Do you also tweak other settings for ZRAM? According to ArchWiki PopOS settled for the following settings:

vm.swappiness = 180
vm.watermark_boost_factor = 0
vm.watermark_scale_factor = 125
vm.page-cluster = 0

I am testing this settings right now and cannot say I experience a difference compared to the defaults.

[–] [email protected] 4 points 1 year ago (2 children)

vm.swappiness value should be between 0 and 100 IIRC.

[–] [email protected] 11 points 1 year ago (1 children)
load more comments (1 replies)
load more comments (1 replies)
[–] [email protected] 3 points 1 year ago

I don't really tweak much. I use the Debian default of 50 percent RAM used. For the NAS's I tell it to use lz4 as they're pretty weak cpu-wise.

[–] [email protected] 2 points 1 year ago* (last edited 1 year ago) (1 children)

Has anyone ever actually benchmarked vm.page-cluster = 0? Makes no sense to me to suggest a cpu is so bottlenecked that disabling read-ahead would actually help. If anything it would mitigate the decompression time if it guessed correctly as the work would already be done if left at the default of 3. Normally cpu is not bound when using zram because its quite low cpu anyway.

[–] [email protected] 2 points 1 year ago

For my own usage, I just enabled ZRAM, 50% with zstd and left all other options unchanged, which seems to be the conservative approach and more important: It works on my machines(TM).

I would love to see some benchmarks or even a structured run down about the available options and configurations.

load more comments (2 replies)
[–] [email protected] 28 points 1 year ago (5 children)

If you like ZRAM, make sure you also enable MG-LRU and consider using ZSWAP with z3fold allocator instead because it's capable of dumping older compressed pages to swap file whereas ZRAM, once full, is simply bypassed until pages in the store are freed.

I do number crunching on memory constrained systems. MG-LRU improves the efficiency of page reclaim, and ZSWAP interacts much more nicely if you have a swap file also.

[–] [email protected] 11 points 1 year ago (1 children)

Thank you for your advice. Right now my setup works so I'll try to not waste my entire weekend playing with technology, but if I need further tweaks in the future I'll look into ZSWAP.

One question: Do you know why Fedora and PopOS decided for ZRAM and against ZSWAP? As I wrote already somewhere else: I did choose ZRAM for it being default in Fedora, which gave me some trust that people better informed/experienced choose ZRAM over ZSWAP.

[–] [email protected] 8 points 1 year ago (1 children)

Totally understandable. I have done the wasting of weekends just to go back to where I started.

I think that ZRAM has a simpler implementation and has a history of being more widely used whereas ZSWAP is only recently seeing more usage as a default. I suspect it's in the interest of stability and because the implementation is better characterized.

With that said, MG-LRU is not enabled by default for the same reason, but it has a big impact such that it's the default on newer Android devices. Stability is a relative term.

[–] [email protected] 4 points 1 year ago

Thank you very much for the write up! I'll have to investigate more about ZSWAP. Have a nice weekend!

load more comments (4 replies)
[–] [email protected] 23 points 1 year ago (2 children)

So ZRAM is RAM, but compressed? I didn't know about it, thanks for sharing!

[–] [email protected] 16 points 1 year ago

Technically it is a compressed SWAP disk in RAM, but the compression ratio is impressive and it feels like more RAM for me. My pleasure to share, hope it will help you someday! :-)

[–] [email protected] 4 points 1 year ago

It's a compressed ram disk (virtual block device) that is often used for swap.

[–] [email protected] 12 points 1 year ago

I use this on all my Pis.

[–] [email protected] 11 points 1 year ago* (last edited 1 year ago)

Some years ago I needed to use more than 100 GB RAM in a 32GB RAM computer, repeatedly. zRAM and swapping in a SSD made the whole thing bearable. In the pandemic, RAM was expensive and I was broke.

[–] [email protected] 11 points 1 year ago* (last edited 1 year ago) (2 children)

How does this compare to zswap. For me, if you still want a swap device on a real disk, this might be better? Idk >.<

Edit: arch has zswap enabled by default https://wiki.archlinux.org/title/Zswap - someone below says it is better if you have zswap when you already have a swap device :)

[–] [email protected] 21 points 1 year ago (2 children)

You don't want to combine zram swap and physical swap. When zram swap is full, you'll get LRU inversion because it won't ever evict from zram swap.

Either zram-only or physical+zswap.

[–] [email protected] 5 points 1 year ago (1 children)

So, if you're using a swap partition/file you don't want zRAM, but zSwap is okay. Am I understanding that right?

[–] [email protected] 3 points 1 year ago
[–] [email protected] 2 points 1 year ago

Thanks ^.^

I have a very shitty notebook this is likely to be very useful for ;p

[–] [email protected] 3 points 1 year ago

Sorry, just a user myself and because ZRAM is default on Fedora and was easy to setup on Debian, I am just using it.

On the Stream, I have a 4G physical swap partition as a backup, though. AFAIK the physical partition will be utilized by ZRAM when needed. (ZRAM simply has higher priority swap).

[–] [email protected] 8 points 1 year ago

A lot of androids are running this now and it seems to work pretty ok.

[–] [email protected] 8 points 1 year ago* (last edited 1 year ago) (4 children)

Isn't zswap enabled by default?

having zram + swap on disk isn't the same as having zswap + swap on disk? the difference should be only that zram show as a swap device while zswap does not.

having only zram, you are still confined by the total ram you have. idk how the average compression ratio is, but you can gain 1.5x ram max. to get more, you need a physical swap device.

is there an advantage of using zram instead of zwap? when you still have a physical swap with lower priority.

bonus question: What if I use all 3 of them? would this just be redundant?

[–] [email protected] 8 points 1 year ago

I used zram + swap for years. I dedicated 25% of my memory to zram. The problem is that zram would get filled with infrequently used data, and disk swap would get the frequently used data. Once that happens everything slows down.

Zswap tries to fix that be creating a compressed swap buffer in memory. Older/less used data will get written to disk, but fresh/frequently used data will stay in the compressed ram buffer. That's my understanding, at least. I don't remember how to query Zswap usage stats.

[–] [email protected] 6 points 1 year ago (2 children)

I am using Debian 12 and I am pretty sure zswap is not enabled by default.

With zstd the compression ratio is better than 3 in all experiments I saw. (Of course you won't get this numbers for random/encrypted data). Right now I have 12MB compressed to 2MB via ZRAM (fresh reboot) which is a factor of 6.

So, taking 3 as factor learned from others and my experience, with 1.8 GB of ZRAM I can store 5.4 GB of memory, adding the 1.8 GB of usual RAM, I end up with 7.2 GB of RAM which is double my 3.6 GB RAM I started with. (All this is backed by 4 GB of physical SWAP.)

Sorry, I cannot really answer your questions concerning zswap vs ZRAM, I just follow the herd and trust that the Fedora people usually have good reasons for their technical choices and are deploying ZRAM by default for several years now.

load more comments (2 replies)
[–] spiffeeroo 4 points 1 year ago

Arch and RHEL enable zswap by default. Regular x86_64 Ubuntu and Debian do not have zswap nor zram enabled by default.

[–] [email protected] 2 points 1 year ago (1 children)

For me zram made my system more responsive but the oomd didn't really count it as more ram so sometimes things would get killed earlier than I'd want. ZRAM + regular swap fixed this unless an application was getting really greedy. I kinda wanna try all three now

[–] [email protected] 5 points 1 year ago* (last edited 1 year ago)

check if zswap is already enabled:

zgrep CONFIG_ZSWAP_DEFAULT_ON /proc/config.gz

https://wiki.archlinux.org/title/zswap

[–] [email protected] 6 points 1 year ago (2 children)

zram did wonders back then to the performance/usability of Palm/HP webOS devices, especially the 1st Pre.

[–] [email protected] 4 points 1 year ago

I loved my Palm Pre 😔

[–] [email protected] 3 points 1 year ago

I adored my HP Veer, I bet that if I get a working one in my hands I'll blind-type flawless again in seconds, I was better on that thing than any full size keyboard. Best phone I've ever had because of the keyboard and the ease of customization when you know Javascript. Screen was a bit too small (I consider every modern phone way, way too big) and speed could've been better but wasn't bad.

[–] [email protected] 4 points 1 year ago

Having had massive problems using normal swap in combination with zfs in out of memory situations with high memory pressure I now only - but as default - use zram on bare-metal machines.

[–] [email protected] 3 points 1 year ago (1 children)

Thanks [email protected] !

Thanks to your post and plenty of config tutorials, I've got this set up on my Oracle Free Tier VPS running Ubuntu. It has recently been struggling hard with 1GB ram, requiring reboot. The difference with zram enabled... WOW.

I haven't been able to get zram working on my Ubuntu VPS with another provider though - search results suggest that some providers don't allow swap.

load more comments (1 replies)
[–] [email protected] 2 points 1 year ago

I have 64 GB of memory in my desktop with 16 GB of zswap. Can't say I've noticed any difference because I haven't actually been in a situation that uses all this memory yet (aside from some programs leaking memory), but the thought of getting "free" RAM is appealing to me.

load more comments
view more: next ›