Rocksolid Light

News from da outaworlds

mail  files  register  groups  login

Message-ID:  

BOFH excuse #161: monitor VLF leakage


comp / comp.os.linux.misc / Re: Linux doesn't seem to manage memory very well

SubjectAuthor
* Linux doesn't seem to manage memory very wellJames Harris
+* Re: Linux doesn't seem to manage memory very wellMarc Haber
|`* Re: Linux doesn't seem to manage memory very wellJames Harris
| +* Re: Linux doesn't seem to manage memory very wellMarc Haber
| |`* Re: Linux doesn't seem to manage memory very wellRich
| | `- Re: Linux doesn't seem to manage memory very wellMarc Haber
| `* Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
|  `- Re: Linux user doesn't seem to manage memory very wellCharlie Gibbs
+* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
|+- Re: Linux doesn't seem to manage memory very wellcandycanearter07
|+- Re: Linux doesn't seem to manage memory very wellLawrence D'Oliveiro
|`* Re: Linux doesn't seem to manage memory very wellJames Harris
| +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |`- Re: Linux doesn't seem to manage memory very wellcandycanearter07
| `- Re: Linux doesn't seem to manage memory very wellJoerg Walther
+* Re: Linux doesn't seem to manage memory very wellDavid W. Hodgins
|`* Re: Linux doesn't seem to manage memory very wellJames Harris
| +- Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| +- Re: Linux doesn't seem to manage memory very wellDavid W. Hodgins
| `- Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
+* Re: Linux doesn't seem to manage memory very wellLew Pitcher
|`* Re: Linux doesn't seem to manage memory very wellKenny McCormack
| +* Re: Linux doesn't seem to manage memory very wellRichard Kettlewell
| |+- Re: Linux doesn't seem to manage memory very wellLawrence D'Oliveiro
| |`* Re: Linux doesn't seem to manage memory very wellMarc Haber
| | `- Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| +* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |+- Re: Linux doesn't seem to manage memory very wellMarc Haber
| |`* Re: Linux doesn't seem to manage memory very wellJames Harris
| | `* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |  `* Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |   +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |   |`* Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |   | `* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |   |  `- Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |   `* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |    `* Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |     +- Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |     +* Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
| |     |`- Re: Linux user doesn't seem to manage memory very wellComputer Nerd Kev
| |     +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |     |`* Re: Linux doesn't seem to manage memory very wellcandycanearter07
| |     | `- Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |     `- Re: Linux doesn't seem to manage memory very wellcandycanearter07
| `* Re: Linux doesn't seem to manage memory very wellJames Harris
|  `* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
|   `* Re: Linux doesn't seem to manage memory very wellJames Harris
|    `* Re: Linux doesn't seem to manage memory very wellRichard Kettlewell
|     `- Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
+- Re: Linux doesn't seem to manage memory very wellMarco Moock
+* Re: Linux doesn't seem to manage memory very wellGrant Taylor
|+* Re: Linux doesn't seem to manage memory very wellcandycanearter07
||`* Re: Linux doesn't seem to manage memory very wellGrant Taylor
|| `* Re: Linux doesn't seem to manage memory very wellMarc Haber
||  `* Re: Linux doesn't seem to manage memory very wellLawrence D'Oliveiro
||   +- Re: Linux doesn't seem to manage memory very wellAndy Burns
||   +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
||   |`* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
||   | `- Re: Linux doesn't seem to manage memory very wellMarc Haber
||   +- Re: Linux doesn't seem to manage memory very wellMarc Haber
||   `* Re: Linux doesn't seem to manage memory very wellRich
||    `- Re: Linux doesn't seem to manage memory very wellCarlos E.R.
|`- Re: Linux doesn't seem to manage memory very wellJames Harris
+* Re: Linux doesn't seem to manage memory very wellD
|+- Re: Linux doesn't seem to manage memory very well26xh.0717
|`- Re: Linux doesn't seem to manage memory very well26xh.0717
+- Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
`* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
 +- Re: Linux doesn't seem to manage memory very wellRich
 `- Re: Linux doesn't seem to manage memory very wellJames Harris

Pages:123
Subject: Re: Linux doesn't seem to manage memory very well
From: Marc Haber
Newsgroups: comp.os.linux.misc
Organization: private site, see http://www.zugschlus.de/ for details
Date: Thu, 2 May 2024 11:05 UTC
References: 1 2 3 4
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!weretis.net!feeder8.news.weretis.net!news1.tnib.de!feed.news.tnib.de!news.tnib.de!.POSTED.torres.zugschlus.de!not-for-mail
From: mh+usenetspam1118@zugschl.us (Marc Haber)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 02 May 2024 13:05:57 +0200
Organization: private site, see http://www.zugschlus.de/ for details
Message-ID: <v0vs2l$ddb7$1@news1.tnib.de>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me> <v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 2 May 2024 11:05:57 -0000 (UTC)
Injection-Info: news1.tnib.de; posting-host="torres.zugschlus.de:81.169.166.32";
logging-data="439655"; mail-complaints-to="abuse@tnib.de"
X-Newsreader: Forte Agent 6.00/32.1186
View all headers

"Carlos E.R." <robin_listas@es.invalid> wrote:
>On 2024-05-01 22:42, Kenny McCormack wrote:
>> In article <v0tkdc$3780t$1@dont-email.me>,
>> Lew Pitcher <lew.pitcher@digitalfreehold.ca> wrote:
>>> On Wed, 01 May 2024 11:32:18 +0100, James Harris wrote:
>>>
>>>> Not a question, just an observation.
>> ...
>>>
>>> So, if you want help, how about providing some details.
>>
>> OP was pretty clear that he was *not* seeking help.
>
>Because he is blaming Linux at large, when he has a problem in *his*
>system. He made a wrong diagnosis.

And a frequent one for crying out loud. Heck, there is an FAQ about
this very issue.

Memory management is always "too little, too slow", impossible to do
right for everybody.

Greetings
Marc
--
----------------------------------------------------------------------------
Marc Haber | " Questions are the | Mailadresse im Header
Rhein-Neckar, DE | Beginning of Wisdom " |
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fon: *49 6224 1600402

Subject: Re: Linux doesn't seem to manage memory very well
From: Marc Haber
Newsgroups: comp.os.linux.misc
Organization: private site, see http://www.zugschlus.de/ for details
Date: Thu, 2 May 2024 11:07 UTC
References: 1 2 3 4 5 6
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!weretis.net!feeder8.news.weretis.net!news1.tnib.de!feed.news.tnib.de!news.tnib.de!.POSTED.torres.zugschlus.de!not-for-mail
From: mh+usenetspam1118@zugschl.us (Marc Haber)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 02 May 2024 13:07:55 +0200
Organization: private site, see http://www.zugschlus.de/ for details
Message-ID: <v0vs6c$ddf6$1@news1.tnib.de>
References: <v0t5nk$3415a$1@dont-email.me> <v0tl23$j31$1@tncsrv09.home.tnetconsulting.net> <v0trh9$39235$1@dont-email.me> <v0u3vi$lda$1@tncsrv09.home.tnetconsulting.net> <v0v9d7$bqb2$1@news1.tnib.de> <v0vcpc$3n0k7$2@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 2 May 2024 11:07:56 -0000 (UTC)
Injection-Info: news1.tnib.de; posting-host="torres.zugschlus.de:81.169.166.32";
logging-data="439782"; mail-complaints-to="abuse@tnib.de"
X-Newsreader: Forte Agent 6.00/32.1186
View all headers

Lawrence D'Oliveiro <ldo@nz.invalid> wrote:
>On Thu, 02 May 2024 07:47:19 +0200, Marc Haber wrote:
>> No mechanic ever had to appear in front of a board to justify the use of
>> spanner and screw driver, right?
>
>I’m sure they do, to whomever controls the purse strings at the garage.

Show me a single garage without spanner or screw driver.

Greetings
Marc
--
----------------------------------------------------------------------------
Marc Haber | " Questions are the | Mailadresse im Header
Rhein-Neckar, DE | Beginning of Wisdom " |
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fon: *49 6224 1600402

Subject: Re: Linux doesn't seem to manage memory very well
From: Marc Haber
Newsgroups: comp.os.linux.misc
Organization: private site, see http://www.zugschlus.de/ for details
Date: Thu, 2 May 2024 11:08 UTC
References: 1 2 3 4 5 6 7 8
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!weretis.net!feeder8.news.weretis.net!news1.tnib.de!feed.news.tnib.de!news.tnib.de!.POSTED.torres.zugschlus.de!not-for-mail
From: mh+usenetspam1118@zugschl.us (Marc Haber)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 02 May 2024 13:08:55 +0200
Organization: private site, see http://www.zugschlus.de/ for details
Message-ID: <v0vs87$ddhd$1@news1.tnib.de>
References: <v0t5nk$3415a$1@dont-email.me> <v0tl23$j31$1@tncsrv09.home.tnetconsulting.net> <v0trh9$39235$1@dont-email.me> <v0u3vi$lda$1@tncsrv09.home.tnetconsulting.net> <v0v9d7$bqb2$1@news1.tnib.de> <v0vcpc$3n0k7$2@dont-email.me> <v0vfnv$3nn6g$1@dont-email.me> <qvtbgkxbnb.ln2@Telcontar.valinor>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 2 May 2024 11:08:55 -0000 (UTC)
Injection-Info: news1.tnib.de; posting-host="torres.zugschlus.de:81.169.166.32";
logging-data="439853"; mail-complaints-to="abuse@tnib.de"
X-Newsreader: Forte Agent 6.00/32.1186
View all headers

"Carlos E.R." <robin_listas@es.invalid> wrote:
>On 2024-05-02 09:35, The Natural Philosopher wrote:
>> On 02/05/2024 07:45, Lawrence D'Oliveiro wrote:
>>> On Thu, 02 May 2024 07:47:19 +0200, Marc Haber wrote:
>>>
>>>> No mechanic ever had to appear in front of a board to justify the use of
>>>> spanner and screw driver, right?
>>>
>>> I’m sure they do, to whomever controls the purse strings at the garage.
>>
>> Well indeed. Although not a board, just the boss.
>
>My mechanic boss has to query the board. It is a chain.
>Not for a spanner, but for expensive diagnostic tools.

htop or atop are not expensive. They're available in all major
distribution's repositories ready for installation.

Greetings
Marc, who is responsible for atop turning up in Debian's repositories
--
----------------------------------------------------------------------------
Marc Haber | " Questions are the | Mailadresse im Header
Rhein-Neckar, DE | Beginning of Wisdom " |
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fon: *49 6224 1600402

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 13:47 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 14:47:24 +0100
Organization: A noiseless patient Spider
Lines: 45
Message-ID: <v105hc$3sg37$2@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6ia$6arr$1@news1.tnib.de>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 02 May 2024 15:47:25 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/nWNHb0chb9zmeQ8HFFx7Mlvq5T1JtS+A="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:J14xu1Rv6zzs4idpYKzYHllRwTw=
Content-Language: en-GB
In-Reply-To: <v0t6ia$6arr$1@news1.tnib.de>
View all headers

On 01/05/2024 11:46, Marc Haber wrote:
> James Harris <james.harris.1@gmail.com> wrote:
>> Not a question, just an observation.
>
> A freqently wrong one as well.
>
>> I say that Linux doesn't seem to handle memory well because my laptop
>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>> for a similar workload). Under Linux the RAM would fill up and then swap
>> space would be used. Then the machine would become largely unresponsive
>> - e.g. taking minutes to switch between windows.
>>
>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)! But
>> even so, RAM has still steadily filled up until reaching the full 24GB.
>> What's more, it's now showing 4.8GB of swap space in use.
>
> Linux swaps out lesser used pages anyway to make the backing memory
> available for buffers or cache.
>
> Those people writing memory management are really smart. Smarter than
> you and me together. Don't assume them being stupid.

It may be unwise to assume there's such expertise. A number of years ago
I came up with what I thought was a sensible design for a paging system.
I later found that it corresponded very closely to the one used in
Windows and differed markedly from the paging system used in Linux. I
remember thinking that the latter was not a good design and since then
I've experienced problems with Linux when memory fills up which I tend
to assume are down to the design of its paging system - hence the,
admittedly provocative, title of this thread.

I can't remember much about it now and Linux may well have changed the
way it handles page depletion but my experience as a Linux user seems to
bear out my negative view of its page management.

Whatever the details, in defence of Linux it should be noted that the
Linux design may have to cope with a much broader range of hardware -
e.g. CPUs which have no accessed or dirty bits - whereas Windows was x86
focussed.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 13:50 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 14:50:28 +0100
Organization: A noiseless patient Spider
Lines: 29
Message-ID: <v105n4$3sg37$3@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6vp$34adu$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 02 May 2024 15:50:28 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+M30du8dE7Mbf/OL8hwr1ER6X9jXNqlpc="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:wqslgidm/yDTMRHhlt2HIPOZrOA=
In-Reply-To: <v0t6vp$34adu$1@dont-email.me>
Content-Language: en-GB
View all headers

On 01/05/2024 11:53, The Natural Philosopher wrote:
> On 01/05/2024 11:32, James Harris wrote:
>> Not a question, just an observation.
>>
>> I say that Linux doesn't seem to handle memory well because my laptop
>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>> for a similar workload). Under Linux the RAM would fill up and then
>> swap space would be used. Then the machine would become largely
>> unresponsive - e.g. taking minutes to switch between windows.
>>
>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)! But
>> even so, RAM has still steadily filled up until reaching the full
>> 24GB. What's more, it's now showing 4.8GB of swap space in use.
>>
>>
> That's not Linux. That's a rogue program with a memory leak...

It may not be a memory leak but it's certainly a rogue program -
chrome/chromium in this case, though I've had similar and worse problems
with Firefox which seems to me more likely to have a genuine memory leak.

However, the point of the original post was to vent a frustration about
the way that Linux handles such memory deletion when it happens.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 13:54 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 14:54:30 +0100
Organization: A noiseless patient Spider
Lines: 39
Message-ID: <v105um$3sg37$4@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me>
<op.2m3iszoxa3w0dxdave@hodgins.homeip.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 02 May 2024 15:54:31 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/cGWA4qmKd+f++nTq1f0KOhstcGwUV2eA="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:eOxIpUemlwWscDDm6rWwHO0YkeU=
In-Reply-To: <op.2m3iszoxa3w0dxdave@hodgins.homeip.net>
Content-Language: en-GB
View all headers

On 01/05/2024 15:06, David W. Hodgins wrote:
> On Wed, 01 May 2024 06:32:18 -0400, James Harris
> <james.harris.1@gmail.com> wrote:
>> Not a question, just an observation.
>> I say that Linux doesn't seem to handle memory well because my laptop
>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>> for a similar workload). Under Linux the RAM would fill up and then swap
>> space would be used. Then the machine would become largely unresponsive
>> - e.g. taking minutes to switch between windows.
>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)! But
>> even so, RAM has still steadily filled up until reaching the full 24GB.
>> What's more, it's now showing 4.8GB of swap space in use.
>
> Likely you're using a system that's configured for maximum total
> throughput,
> not best response time.
>
> Create a file, /etc/sysctl.d/tales.conf with the contents ...
> # Reduce applications being swapped
> vm.swappiness=1
> # Don't shrink the inode cache
> vm.vfs_cache_pressure=50
>
> Then run the command "sysctl --system" (as root).
>
> See
> https://rudd-o.com/linux-and-free-software/tales-from-responsivenessland-why-linux-feels-slow-and-how-to-fix-that
> for an explanation.

I very much like the control that Linux gives to a user but ISTM that
what you say here is a great example of the issue I was pointing out in
the original post: IMO page depletion should be handled better *by
default* and not need human intervention for normal scenarios.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 14:01 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 15:01:08 +0100
Organization: A noiseless patient Spider
Lines: 23
Message-ID: <v106b4$3sg37$5@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 02 May 2024 16:01:08 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX194UXAvaH9IotL+uTF7DDIp6orEpfS/O0M="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:ixMDH+yzyD5tMDOPKLG1Pp1AZUI=
Content-Language: en-GB
In-Reply-To: <v0u9g9$f5jt$1@news.xmission.com>
View all headers

On 01/05/2024 21:42, Kenny McCormack wrote:
> In article <v0tkdc$3780t$1@dont-email.me>,
> Lew Pitcher <lew.pitcher@digitalfreehold.ca> wrote:
>> On Wed, 01 May 2024 11:32:18 +0100, James Harris wrote:
>>
>>> Not a question, just an observation.
> ...
>>
>> So, if you want help, how about providing some details.
>
> OP was pretty clear that he was *not* seeking help.

Correct. I don't want to overtax the expert assistance that's clearly
available from posters to this newsgroup and would rather ask for help
relatively rarely, so I am not looking (at least, yet!) for a solution.
My point, in this thread, was, instead, to comment on what I perceive to
be an OS-design issue - a long-term interest.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 14:06 UTC
References: 1 2 3 4
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 15:06:55 +0100
Organization: A noiseless patient Spider
Lines: 32
Message-ID: <v106lv$3sg37$6@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 02 May 2024 16:06:55 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX18ZCiqY6vT5FOGZA9Jwr71FMHML5Del35g="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:+V2uED1kSXITXgMahNQPNtyGKgM=
In-Reply-To: <pqmbgkxe9o.ln2@Telcontar.valinor>
Content-Language: en-GB
View all headers

On 02/05/2024 07:01, Carlos E.R. wrote:
> On 2024-05-01 22:42, Kenny McCormack wrote:
>> In article <v0tkdc$3780t$1@dont-email.me>,
>> Lew Pitcher  <lew.pitcher@digitalfreehold.ca> wrote:
>>> On Wed, 01 May 2024 11:32:18 +0100, James Harris wrote:
>>>
>>>> Not a question, just an observation.
>> ...
>>>
>>> So, if you want help, how about providing some details.
>>
>> OP was pretty clear that he was *not* seeking help.
>
> Because he is blaming Linux at large, when he has a problem in *his*
> system. He made a wrong diagnosis.

Yes, I am (at least tentatively) blaming Linux but not for the problem
you think. I wouldn't expect Linux to prevent programs from gobbling up
memory but I would expect it to manage memory hogs more gracefully than
it does. IME Windows handles the same situation better - and that may be
down to the different designs of their paging systems.

Don't get me wrong. I much prefer Linux to Windows and have often seen
Windows get into a worse situation under different circumstances. But
for page management ISTM that the design of Linux's paging subsystem may
not be the best.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: Rich
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 14:11 UTC
References: 1 2 3 4 5 6
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: rich@example.invalid (Rich)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 14:11:21 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 14
Message-ID: <v106u9$3so2d$3@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tl23$j31$1@tncsrv09.home.tnetconsulting.net> <v0trh9$39235$1@dont-email.me> <v0u3vi$lda$1@tncsrv09.home.tnetconsulting.net> <v0v9d7$bqb2$1@news1.tnib.de> <v0vcpc$3n0k7$2@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 02 May 2024 16:11:22 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="1141aa5a52dd0ac99e8a5d1c958db114";
logging-data="4087885"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+845rRnWBTXeJEFErnH9cU"
User-Agent: tin/2.6.1-20211226 ("Convalmore") (Linux/5.15.139 (x86_64))
Cancel-Lock: sha1:dpRO2tM624arw/Ze5FuVobnWGrw=
View all headers

Lawrence D'Oliveiro <ldo@nz.invalid> wrote:
> On Thu, 02 May 2024 07:47:19 +0200, Marc Haber wrote:
>
>> No mechanic ever had to appear in front of a board to justify the use of
>> spanner and screw driver, right?
>
> I’m sure they do, to whomever controls the purse strings at the garage.

At nearly all auto-shops, the basic tools (spanners/screwdrivers/etc.)
are purchased and owned by the actual mechanics using them and not the
operator of the garage. What the shop owner provides are the
"infrastructure" items (lifts, air compressor, some of the more
specialized tools, such as the tyre changer or the 'computer diagnostic
rack', etc.).

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 14:14 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 15:14:01 +0100
Organization: A noiseless patient Spider
Lines: 23
Message-ID: <v10739$3sg37$7@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me>
<v0tl23$j31$1@tncsrv09.home.tnetconsulting.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 02 May 2024 16:14:02 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19hpTu8Xgu+HQ419G0UjToiSKifS7QMybY="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:n+pLCuXjfwMkuAu4/Q+hhnLI0MI=
Content-Language: en-GB
In-Reply-To: <v0tl23$j31$1@tncsrv09.home.tnetconsulting.net>
View all headers

On 01/05/2024 15:53, Grant Taylor wrote:
> On 5/1/24 05:32, James Harris wrote:
>> Not a question, just an observation.
>
> There more to it than just the amount of free RAM.
>
>> I say that Linux doesn't seem to handle memory well because my laptop
>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>> for a similar workload). Under Linux the RAM would fill up and then
>> swap space would be used. Then the machine would become largely
>> unresponsive - e.g. taking minutes to switch between windows.
>
> Linux uses otherwise unused RAM for disk cache:
>
> Link - Help! Linux ate my RAM!
>  - https://www.linuxatemyram.com/

Thanks. Some very useful info there. Bookmarked.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: Rich
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 14:15 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: rich@example.invalid (Rich)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 14:15:59 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 25
Message-ID: <v1076u$3so2d$4@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <enmbgkxe9o.ln2@Telcontar.valinor>
Injection-Date: Thu, 02 May 2024 16:15:59 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="1141aa5a52dd0ac99e8a5d1c958db114";
logging-data="4087885"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/ygTdP4avdBZBmJ/jtx4fg"
User-Agent: tin/2.6.1-20211226 ("Convalmore") (Linux/5.15.139 (x86_64))
Cancel-Lock: sha1:pftYbTsaWdYLuQvxFId2VJdKzjU=
View all headers

Carlos E.R. <robin_listas@es.invalid> wrote:
> On 2024-05-01 12:32, James Harris wrote:
>> Not a question, just an observation.
>>
>> I say that Linux doesn't seem to handle memory well because my laptop
>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>> for a similar workload). Under Linux the RAM would fill up and then swap
>> space would be used. Then the machine would become largely unresponsive
>> - e.g. taking minutes to switch between windows.
>>
>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)! But
>> even so, RAM has still steadily filled up until reaching the full 24GB.
>> What's more, it's now showing 4.8GB of swap space in use.
>
> No, your analysis is not correct.
>
> You have some buggy application or service that is eating all the
> memory. You have to search and hunt for it.

Another reply indicates that his issue is the fact that browsers
(Chrome, Firefox) are bloated, memory hungry, "leaks" that eventually
eat all of ram, driving any system's memory management to insanity.

This, unfortuantely, is just a fact of browsers. They eat memory to no
end.

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 14:18 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 15:18:41 +0100
Organization: A noiseless patient Spider
Lines: 17
Message-ID: <v107c1$3sg37$8@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <enmbgkxe9o.ln2@Telcontar.valinor>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 02 May 2024 16:18:42 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="99d5fd730d26cbf37522df16daa5f91f";
logging-data="4079719"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/XdNpqRLDmDztrVnwTFqf6kcpgYlZOny0="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:0BYLYsZDUtimq50+WKaPRlwOjv0=
Content-Language: en-GB
In-Reply-To: <enmbgkxe9o.ln2@Telcontar.valinor>
View all headers

On 02/05/2024 06:59, Carlos E.R. wrote:
> On 2024-05-01 12:32, James Harris wrote:
>> Not a question, just an observation.

....

> Do you want our help?

Not on this. At least not at this stage. Thanks for asking. However, I
may well come back on separate threads about other things which are more
genuinely problematic for me.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: Marc Haber
Newsgroups: comp.os.linux.misc
Organization: private site, see http://www.zugschlus.de/ for details
Date: Thu, 2 May 2024 14:41 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!weretis.net!feeder8.news.weretis.net!news1.tnib.de!feed.news.tnib.de!news.tnib.de!.POSTED.torres.zugschlus.de!not-for-mail
From: mh+usenetspam1118@zugschl.us (Marc Haber)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 02 May 2024 16:41:29 +0200
Organization: private site, see http://www.zugschlus.de/ for details
Message-ID: <v108mq$eclb$1@news1.tnib.de>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6ia$6arr$1@news1.tnib.de> <v105hc$3sg37$2@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 2 May 2024 14:41:30 -0000 (UTC)
Injection-Info: news1.tnib.de; posting-host="torres.zugschlus.de:81.169.166.32";
logging-data="471723"; mail-complaints-to="abuse@tnib.de"
X-Newsreader: Forte Agent 6.00/32.1186
View all headers

James Harris <james.harris.1@gmail.com> wrote:
>It may be unwise to assume there's such expertise. A number of years ago
>I came up with what I thought was a sensible design for a paging system.
>I later found that it corresponded very closely to the one used in
>Windows and differed markedly from the paging system used in Linux. I
>remember thinking that the latter was not a good design and since then
>I've experienced problems with Linux when memory fills up which I tend
>to assume are down to the design of its paging system - hence the,
>admittedly provocative, title of this thread.

There is more than way to do it. Windows and Linux are both operating
systems, and still fundamentally different. For example, firing up a
new process is vastly more expensive in Windows than Linux's fork()
mechanism. There is no "better" or "worse" in that comparision.

I don't know enough about VMS, but didn't the guy who led the design
the process and memory management layer for Windows NT come from
Digital Equipment?

Greetings
Marc
--
----------------------------------------------------------------------------
Marc Haber | " Questions are the | Mailadresse im Header
Rhein-Neckar, DE | Beginning of Wisdom " |
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fon: *49 6224 1600402

Subject: Re: Linux doesn't seem to manage memory very well
From: Rich
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 16:18 UTC
References: 1 2 3 4
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: rich@example.invalid (Rich)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 16:18:52 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 26
Message-ID: <v10edc$3um1u$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6ia$6arr$1@news1.tnib.de> <v105hc$3sg37$2@dont-email.me> <v108mq$eclb$1@news1.tnib.de>
Injection-Date: Thu, 02 May 2024 18:18:52 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="1141aa5a52dd0ac99e8a5d1c958db114";
logging-data="4151358"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+Pe9Ah3LdtoJRzrGK4gisZ"
User-Agent: tin/2.6.1-20211226 ("Convalmore") (Linux/5.15.139 (x86_64))
Cancel-Lock: sha1:f9lCgCwR0AbHrG/Jl4ygbTwZshI=
View all headers

Marc Haber <mh+usenetspam1118@zugschl.us> wrote:
> James Harris <james.harris.1@gmail.com> wrote:
>>It may be unwise to assume there's such expertise. A number of years ago
>>I came up with what I thought was a sensible design for a paging system.
>>I later found that it corresponded very closely to the one used in
>>Windows and differed markedly from the paging system used in Linux. I
>>remember thinking that the latter was not a good design and since then
>>I've experienced problems with Linux when memory fills up which I tend
>>to assume are down to the design of its paging system - hence the,
>>admittedly provocative, title of this thread.
>
> There is more than way to do it. Windows and Linux are both operating
> systems, and still fundamentally different. For example, firing up a
> new process is vastly more expensive in Windows than Linux's fork()
> mechanism. There is no "better" or "worse" in that comparision.
>
> I don't know enough about VMS, but didn't the guy who led the design
> the process and memory management layer for Windows NT come from
> Digital Equipment?

Yes, Dave Cutler, chief architect for VMS, plus much of the DEC VMS
team that remained at the time.

https://en.wikipedia.org/wiki/Dave_Cutler

The core innards of NT are supposedly *very* VMS like.

Subject: Re: Linux doesn't seem to manage memory very well
From: Marc Haber
Newsgroups: comp.os.linux.misc
Organization: private site, see http://www.zugschlus.de/ for details
Date: Thu, 2 May 2024 18:04 UTC
References: 1 2 3 4 5
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!weretis.net!feeder8.news.weretis.net!news1.tnib.de!feed.news.tnib.de!news.tnib.de!.POSTED.torres.zugschlus.de!not-for-mail
From: mh+usenetspam1118@zugschl.us (Marc Haber)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 02 May 2024 20:04:19 +0200
Organization: private site, see http://www.zugschlus.de/ for details
Message-ID: <v10kj3$fd6b$1@news1.tnib.de>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6ia$6arr$1@news1.tnib.de> <v105hc$3sg37$2@dont-email.me> <v108mq$eclb$1@news1.tnib.de> <v10edc$3um1u$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Injection-Date: Thu, 2 May 2024 18:04:19 -0000 (UTC)
Injection-Info: news1.tnib.de; posting-host="torres.zugschlus.de:81.169.166.32";
logging-data="505035"; mail-complaints-to="abuse@tnib.de"
X-Newsreader: Forte Agent 6.00/32.1186
View all headers

Rich <rich@example.invalid> wrote:
>The core innards of NT are supposedly *very* VMS like.

And VMS was VERY different to Unix, so it is hardly surprising that
Windows today does many things different than Linux. And I think
that's a good thing.

Greetings
Marc
--
----------------------------------------------------------------------------
Marc Haber | " Questions are the | Mailadresse im Header
Rhein-Neckar, DE | Beginning of Wisdom " |
Nordisch by Nature | Lt. Worf, TNG "Rightful Heir" | Fon: *49 6224 1600402

Subject: Re: Linux doesn't seem to manage memory very well
From: Carlos E.R.
Newsgroups: comp.os.linux.misc
Date: Thu, 2 May 2024 19:15 UTC
References: 1 2 3 4 5 6 7
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: robin_listas@es.invalid (Carlos E.R.)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 21:15:24 +0200
Lines: 27
Message-ID: <cb5dgkxo12.ln2@Telcontar.valinor>
References: <v0t5nk$3415a$1@dont-email.me>
<v0tl23$j31$1@tncsrv09.home.tnetconsulting.net>
<v0trh9$39235$1@dont-email.me>
<v0u3vi$lda$1@tncsrv09.home.tnetconsulting.net> <v0v9d7$bqb2$1@news1.tnib.de>
<v0vcpc$3n0k7$2@dont-email.me> <v106u9$3so2d$3@dont-email.me>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net Y94K2BX5g4x0EHT1Fg8JoAEnhc5mT0Xbo3FJTcIpFhq9vb9gYE
X-Orig-Path: Telcontar.valinor!not-for-mail
Cancel-Lock: sha1:neWxeNygblpoGyT+GaaExiJ6b+U= sha256:LPqSVlmG8T27umx8fIVy2iZmnLal7lcUsFpw47u3Ulo=
User-Agent: Mozilla Thunderbird
Content-Language: es-ES, en-CA
In-Reply-To: <v106u9$3so2d$3@dont-email.me>
View all headers

On 2024-05-02 16:11, Rich wrote:
> Lawrence D'Oliveiro <ldo@nz.invalid> wrote:
>> On Thu, 02 May 2024 07:47:19 +0200, Marc Haber wrote:
>>
>>> No mechanic ever had to appear in front of a board to justify the use of
>>> spanner and screw driver, right?
>>
>> I’m sure they do, to whomever controls the purse strings at the garage.
>
> At nearly all auto-shops, the basic tools (spanners/screwdrivers/etc.)
> are purchased and owned by the actual mechanics using them and not the
> operator of the garage. What the shop owner provides are the
> "infrastructure" items (lifts, air compressor, some of the more
> specialized tools, such as the tyre changer or the 'computer diagnostic
> rack', etc.).

Not here.

The entrepeneur, the boss, the owner, hires the mechanics and must
provide everything. Protective clothing and gear, tools. Yes, every tool
is owned by the garage. The employee is not required to provide anything
except his person and knowledge and time and effort.

--
Cheers, Carlos.

Subject: Re: Linux doesn't seem to manage memory very well
From: Carlos E.R.
Newsgroups: comp.os.linux.misc
Date: Thu, 2 May 2024 19:19 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: robin_listas@es.invalid (Carlos E.R.)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 21:19:49 +0200
Lines: 45
Message-ID: <lj5dgkxo12.ln2@Telcontar.valinor>
References: <v0t5nk$3415a$1@dont-email.me>
<op.2m3iszoxa3w0dxdave@hodgins.homeip.net> <v105um$3sg37$4@dont-email.me>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Trace: individual.net xTSUMJkr097lRAw1guTr3QHxGVR5DpnAeh+QVhaBmVHsfK50IJ
X-Orig-Path: Telcontar.valinor!not-for-mail
Cancel-Lock: sha1:sYsHAtP6olPQyauc+Z6yBZg8RrA= sha256:VKIqmXhIE2jrET0+Mv6Nj+qOO7qVcjoRfYP7wZ0oTvo=
User-Agent: Mozilla Thunderbird
Content-Language: es-ES, en-CA
In-Reply-To: <v105um$3sg37$4@dont-email.me>
View all headers

On 2024-05-02 15:54, James Harris wrote:
> On 01/05/2024 15:06, David W. Hodgins wrote:
>> On Wed, 01 May 2024 06:32:18 -0400, James Harris
>> <james.harris.1@gmail.com> wrote:
>>> Not a question, just an observation.
>>> I say that Linux doesn't seem to handle memory well because my laptop
>>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>>> for a similar workload). Under Linux the RAM would fill up and then swap
>>> space would be used. Then the machine would become largely unresponsive
>>> - e.g. taking minutes to switch between windows.
>>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)! But
>>> even so, RAM has still steadily filled up until reaching the full 24GB.
>>> What's more, it's now showing 4.8GB of swap space in use.
>>
>> Likely you're using a system that's configured for maximum total
>> throughput,
>> not best response time.
>>
>> Create a file, /etc/sysctl.d/tales.conf with the contents ...
>> # Reduce applications being swapped
>> vm.swappiness=1
>> # Don't shrink the inode cache
>> vm.vfs_cache_pressure=50
>>
>> Then run the command "sysctl --system" (as root).
>>
>> See
>> https://rudd-o.com/linux-and-free-software/tales-from-responsivenessland-why-linux-feels-slow-and-how-to-fix-that
>> for an explanation.
>
> I very much like the control that Linux gives to a user but ISTM that
> what you say here is a great example of the issue I was pointing out in
> the original post: IMO page depletion should be handled better *by
> default* and not need human intervention for normal scenarios.

It is up to you to set the defaults.

The defaults you get were set by the distribution, and each distribution
does this differently.

hint: ulimit.

--
Cheers, Carlos.

Subject: Re: Linux doesn't seem to manage memory very well
From: David W. Hodgins
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Thu, 2 May 2024 20:46 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: dwhodgins@nomail.afraid.org (David W. Hodgins)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 02 May 2024 16:46:10 -0400
Organization: A noiseless patient Spider
Lines: 22
Message-ID: <op.2m5vy8dsa3w0dxdave@hodgins.homeip.net>
References: <v0t5nk$3415a$1@dont-email.me>
<op.2m3iszoxa3w0dxdave@hodgins.homeip.net> <v105um$3sg37$4@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed; delsp=yes
Content-Transfer-Encoding: 8bit
Injection-Date: Thu, 02 May 2024 23:23:11 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="86ec8174bb253d926219829a8c4cde74";
logging-data="95220"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19xJc7juTbFITBML+M7csVCjzA+evXpUu4="
User-Agent: Opera Mail/12.16 (Linux)
Cancel-Lock: sha1:ea1q1TYYoEHPn6HlNdHGwKUHpgQ=
View all headers

On Thu, 02 May 2024 09:54:30 -0400, James Harris <james.harris.1@gmail.com> wrote:
<snip>
> I very much like the control that Linux gives to a user but ISTM that
> what you say here is a great example of the issue I was pointing out in
> the original post: IMO page depletion should be handled better *by
> default* and not need human intervention for normal scenarios.

A system designed for a single user will likely try to make fast response time for
that one user the priority.

Unix and Linux were not designed for that. They were designed to be multi-user
systems that make the best use of available resources the priority, even if
that is at the expense of the response time for one of the poeple sitting at one
of the terminals.

The settings can easily be tweaked to suit the system administrator's priorities.

A distribution is free to alter the defaults it provides, but most choose to keep
the upstream defaults, to ensure it matches the documentation from the author
of the software.

Regards, Dave Hodgins

Subject: Re: Linux doesn't seem to manage memory very well
From: Carlos E.R.
Newsgroups: comp.os.linux.misc
Date: Thu, 2 May 2024 21:34 UTC
References: 1 2 3 4 5
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: robin_listas@es.invalid (Carlos E.R.)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Thu, 2 May 2024 23:34:25 +0200
Lines: 40
Message-ID: <1gddgkxic6.ln2@Telcontar.valinor>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Trace: individual.net /JSfuEaGfV6kkiGV+DGVogU0dlNd8IKrE/IGr3NqX70nDbmoq4
X-Orig-Path: Telcontar.valinor!not-for-mail
Cancel-Lock: sha1:MYH20JJs1S/BpdA1rx9uAU9rYyg= sha256:L44vXizPiWARw7llfSXffobj/X4Rl7ne/S86KdcuwXc=
User-Agent: Mozilla Thunderbird
Content-Language: es-ES, en-CA
In-Reply-To: <v106lv$3sg37$6@dont-email.me>
View all headers

On 2024-05-02 16:06, James Harris wrote:
> On 02/05/2024 07:01, Carlos E.R. wrote:
>> On 2024-05-01 22:42, Kenny McCormack wrote:
>>> In article <v0tkdc$3780t$1@dont-email.me>,
>>> Lew Pitcher  <lew.pitcher@digitalfreehold.ca> wrote:
>>>> On Wed, 01 May 2024 11:32:18 +0100, James Harris wrote:
>>>>
>>>>> Not a question, just an observation.
>>> ...
>>>>
>>>> So, if you want help, how about providing some details.
>>>
>>> OP was pretty clear that he was *not* seeking help.
>>
>> Because he is blaming Linux at large, when he has a problem in *his*
>> system. He made a wrong diagnosis.
>
> Yes, I am (at least tentatively) blaming Linux but not for the problem
> you think. I wouldn't expect Linux to prevent programs from gobbling up
> memory but I would expect it to manage memory hogs more gracefully than
> it does. IME Windows handles the same situation better - and that may be
> down to the different designs of their paging systems.
>
> Don't get me wrong. I much prefer Linux to Windows and have often seen
> Windows get into a worse situation under different circumstances. But
> for page management ISTM that the design of Linux's paging subsystem may
> not be the best.

You can configure Linux to crash the application that is behaving badly
by grabbing all the memory. It is up to you, the boss.

The philosophy is not to nanny care for you. It does what you asked.
More memory? Yes sir. Till death does us part. Your orders will be obeyed.

:-)

--
Cheers, Carlos.

Subject: Re: Linux doesn't seem to manage memory very well
From: Computer Nerd Kev
Newsgroups: comp.os.linux.misc
Organization: Ausics - https://newsgroups.ausics.net
Date: Thu, 2 May 2024 23:23 UTC
References: 1 2 3 4 5 6
Message-ID: <6634207d@news.ausics.net>
From: not@telling.you.invalid (Computer Nerd Kev)
Subject: Re: Linux doesn't seem to manage memory very well
Newsgroups: comp.os.linux.misc
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me> <v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor> <v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
User-Agent: tin/2.0.1-20111224 ("Achenvoir") (UNIX) (Linux/2.4.31 (i586))
NNTP-Posting-Host: news.ausics.net
Date: 3 May 2024 09:23:42 +1000
Organization: Ausics - https://newsgroups.ausics.net
Lines: 49
X-Complaints: abuse@ausics.net
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!news.bbs.nz!news.ausics.net!not-for-mail
View all headers

Carlos E.R. <robin_listas@es.invalid> wrote:
> On 2024-05-02 16:06, James Harris wrote:
>>
>> Yes, I am (at least tentatively) blaming Linux but not for the problem
>> you think. I wouldn't expect Linux to prevent programs from gobbling up
>> memory but I would expect it to manage memory hogs more gracefully than
>> it does. IME Windows handles the same situation better - and that may be
>> down to the different designs of their paging systems.
>>
>> Don't get me wrong. I much prefer Linux to Windows and have often seen
>> Windows get into a worse situation under different circumstances. But
>> for page management ISTM that the design of Linux's paging subsystem may
>> not be the best.
>
> You can configure Linux to crash the application that is behaving badly
> by grabbing all the memory. It is up to you, the boss.
>
> The philosophy is not to nanny care for you. It does what you asked.
> More memory? Yes sir. Till death does us part. Your orders will be obeyed.
>
> :-)

I didn't know there was an option not to have it do that (via the
Out Of Memory Reaper). It seems the alternatives are to reboot or
risk the kernel crashing, so your description seems about right.

https://www.oracle.com/technical-resources/articles/it-infrastructure/dev-oom-killer.html

The OP has noted now that the process that consumes their RAM is
Chrome or Firefox. I've not seen a detailed description of why it
happens, but I've long noted that Firefox seems to expand its RAM
usage to the available space, but different from a memory leak in
that it usually leaves a certain amount free. I assume that this
in intended behaviour. I run current Firefox on a PC with 2GB RAM
and I don't have it getting killed by the kernel, nor do I have
problems with kernel crashes/reboots. I've also tried running
recent Firefox on a PC with 512MB RAM and noticed that it performs
much worse than with 2GB RAM, slowing down to a crawl while loading
some websites, suggesting that it really does need more RAM in that
case.

I don't use web browsers to play video. If you're streaming super
high resolution video through your browser with the latest and
greatest compression algorithms, then it probably has the right
to chew up a lot of RAM.

--
__ __
#_ < |\| |< _#

Subject: Re: Linux user doesn't seem to manage memory very well
From: Lawrence D'Oliv
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Fri, 3 May 2024 01:47 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: ldo@nz.invalid (Lawrence D'Oliveiro)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux user doesn't seem to manage memory very well
Date: Fri, 3 May 2024 01:47:47 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 11
Message-ID: <v11fo3$9q5g$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6ia$6arr$1@news1.tnib.de>
<v105hc$3sg37$2@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 03 May 2024 03:47:48 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="cfd0dd0a0e9abee8835016bed2d05754";
logging-data="321712"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX184ckkaI6eGSUdAs9YO5SLy"
User-Agent: Pan/0.155 (Kherson; fc5a80b8)
Cancel-Lock: sha1:++eD68uoYM+SQdtIdTJhPEZ13RE=
View all headers

On Thu, 2 May 2024 14:47:24 +0100, James Harris wrote:

> A number of years ago
> I came up with what I thought was a sensible design for a paging system.
> I later found that it corresponded very closely to the one used in
> Windows and differed markedly from the paging system used in Linux. I
> remember thinking that the latter was not a good design ...

Look at all the effort those smart Microsoft engineers had to go to,
just to get Windows file copying to work properly:
<https://techcommunity.microsoft.com/t5/windows-blog-archive/inside-vista-sp1-file-copy-improvements/ba-p/723622>

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Fri, 3 May 2024 05:47 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 06:47:45 +0100
Organization: A little, after lunch
Lines: 46
Message-ID: <v11tq1$celj$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6vp$34adu$1@dont-email.me>
<v105n4$3sg37$3@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 03 May 2024 07:47:46 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="4ce65002836e8d723e70c42918b10bd5";
logging-data="408243"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19uZxxOU5pskIweFN7lke+gnf8ezfEpnCo="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:QagEOnbHZemyQ6v9W20SpK+S4Z8=
In-Reply-To: <v105n4$3sg37$3@dont-email.me>
Content-Language: en-GB
View all headers

On 02/05/2024 14:50, James Harris wrote:
> On 01/05/2024 11:53, The Natural Philosopher wrote:
>> On 01/05/2024 11:32, James Harris wrote:
>>> Not a question, just an observation.
>>>
>>> I say that Linux doesn't seem to handle memory well because my laptop
>>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>>> for a similar workload). Under Linux the RAM would fill up and then
>>> swap space would be used. Then the machine would become largely
>>> unresponsive - e.g. taking minutes to switch between windows.
>>>
>>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)!
>>> But even so, RAM has still steadily filled up until reaching the full
>>> 24GB. What's more, it's now showing 4.8GB of swap space in use.
>>>
>>>
>> That's not Linux. That's a rogue program with a memory leak...
>
> It may not be a memory leak but it's certainly a rogue program -
> chrome/chromium in this case, though I've had similar and worse problems
> with Firefox which seems to me more likely to have a genuine memory leak.
>
> However, the point of the original post was to vent a frustration about
> the way that Linux handles such memory deletion when it happens.
>
>
It is not hard to write a javascript program that eats all memory and
place it on a website.

I even encountered a website that silently ran some sort of proxy server
in my browser and used up all my upload bandwidth.

Linux at least protects you from such sites having root access by default...

--
Future generations will wonder in bemused amazement that the early
twenty-first century’s developed world went into hysterical panic over a
globally average temperature increase of a few tenths of a degree, and,
on the basis of gross exaggerations of highly uncertain computer
projections combined into implausible chains of inference, proceeded to
contemplate a rollback of the industrial age.

Richard Lindzen

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Fri, 3 May 2024 05:50 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 06:50:18 +0100
Organization: A little, after lunch
Lines: 15
Message-ID: <v11tuq$celj$2@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me>
<op.2m3iszoxa3w0dxdave@hodgins.homeip.net> <v105um$3sg37$4@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Fri, 03 May 2024 07:50:19 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="4ce65002836e8d723e70c42918b10bd5";
logging-data="408243"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1+PpSxaB7VD1j1XEHP2UhZkBxx0aNq4ef4="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:z3PngWlVAMLVjIVWOkyn9zFg+s0=
Content-Language: en-GB
In-Reply-To: <v105um$3sg37$4@dont-email.me>
View all headers

On 02/05/2024 14:54, James Harris wrote:
ISTM that
> what you say here is a great example of the issue I was pointing out in
> the original post: IMO page depletion should be handled better *by
> default* and not need human intervention for normal scenarios.
>
IME that is exactly what Linux *does* do.
Handles everything perfectly by default.
Swapping is what happens when *all else fails*.

In Windows, programs simply crash.

--
Microsoft : the best reason to go to Linux that ever existed.

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Fri, 3 May 2024 05:51 UTC
References: 1 2 3 4
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 06:51:08 +0100
Organization: A little, after lunch
Lines: 26
Message-ID: <v11u0c$celj$3@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <v106b4$3sg37$5@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 03 May 2024 07:51:08 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="4ce65002836e8d723e70c42918b10bd5";
logging-data="408243"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/f6ap7Re/r2n3eAyr7X5XB0z0JtiiInGw="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:4KxmIk5FjuKe3KQsDduvflnL4NY=
Content-Language: en-GB
In-Reply-To: <v106b4$3sg37$5@dont-email.me>
View all headers

On 02/05/2024 15:01, James Harris wrote:
> On 01/05/2024 21:42, Kenny McCormack wrote:
>> In article <v0tkdc$3780t$1@dont-email.me>,
>> Lew Pitcher  <lew.pitcher@digitalfreehold.ca> wrote:
>>> On Wed, 01 May 2024 11:32:18 +0100, James Harris wrote:
>>>
>>>> Not a question, just an observation.
>> ...
>>>
>>> So, if you want help, how about providing some details.
>>
>> OP was pretty clear that he was *not* seeking help.
>
> Correct. I don't want to overtax the expert assistance that's clearly
> available from posters to this newsgroup and would rather ask for help
> relatively rarely, so I am not looking (at least, yet!) for a solution.
> My point, in this thread, was, instead, to comment on what I perceive to
> be an OS-design issue - a long-term interest.
>
>
In short anti-linux trolling.
--
“when things get difficult you just have to lie”

― Jean Claud Jüncker

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Fri, 3 May 2024 06:02 UTC
References: 1 2 3 4 5 6 7
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 07:02:34 +0100
Organization: A little, after lunch
Lines: 74
Message-ID: <v11ulq$cmde$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 03 May 2024 08:02:35 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="4ce65002836e8d723e70c42918b10bd5";
logging-data="416174"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX186gmw3ox6xDwLrnKfnASPf5Hps9UMkt8Y="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:Nidd++Mh6H/7uhsC4L0gM1A3BxA=
In-Reply-To: <6634207d@news.ausics.net>
Content-Language: en-GB
View all headers

On 03/05/2024 00:23, Computer Nerd Kev wrote:
> Carlos E.R. <robin_listas@es.invalid> wrote:
>> On 2024-05-02 16:06, James Harris wrote:
>>>
>>> Yes, I am (at least tentatively) blaming Linux but not for the problem
>>> you think. I wouldn't expect Linux to prevent programs from gobbling up
>>> memory but I would expect it to manage memory hogs more gracefully than
>>> it does. IME Windows handles the same situation better - and that may be
>>> down to the different designs of their paging systems.
>>>
>>> Don't get me wrong. I much prefer Linux to Windows and have often seen
>>> Windows get into a worse situation under different circumstances. But
>>> for page management ISTM that the design of Linux's paging subsystem may
>>> not be the best.
>>
>> You can configure Linux to crash the application that is behaving badly
>> by grabbing all the memory. It is up to you, the boss.
>>
>> The philosophy is not to nanny care for you. It does what you asked.
>> More memory? Yes sir. Till death does us part. Your orders will be obeyed.
>>
>> :-)
>
> I didn't know there was an option not to have it do that (via the
> Out Of Memory Reaper). It seems the alternatives are to reboot or
> risk the kernel crashing, so your description seems about right.
>
> https://www.oracle.com/technical-resources/articles/it-infrastructure/dev-oom-killer.html
>
> The OP has noted now that the process that consumes their RAM is
> Chrome or Firefox. I've not seen a detailed description of why it
> happens, but I've long noted that Firefox seems to expand its RAM
> usage to the available space, but different from a memory leak in
> that it usually leaves a certain amount free. I assume that this
> in intended behaviour. I run current Firefox on a PC with 2GB RAM
> and I don't have it getting killed by the kernel, nor do I have
> problems with kernel crashes/reboots. I've also tried running
> recent Firefox on a PC with 512MB RAM and noticed that it performs
> much worse than with 2GB RAM, slowing down to a crawl while loading
> some websites, suggesting that it really does need more RAM in that
> case.
>
> I don't use web browsers to play video. If you're streaming super
> high resolution video through your browser with the latest and
> greatest compression algorithms, then it probably has the right
> to chew up a lot of RAM.
>
I use browsers to play videos. RAM usage is not massive. CPU usage is.

What chews memory are *commercial* websites loaded with (deliberately)
buggy javaScript that cause javaScript engines to go into meltdown. How
that is handled is browser dependent.

Ublock Origin helps massively, but is not a complete answer.
What is a massive help at leats in Mint Mate is the System Monitor
widget that I keep in the task bar permanently displaying CPU, RAM and
Network usage as teeny graphs.
It is very easy to see when memory is all grabbed by a process rather
than simply cache
And monitor how much gets released when you close a website page.

It is configurable to do what htop, top and atop do in a much simpler
way for GUI users
Right now, it looks like Thunderbird is my biggest surprise at almost a
gigabyte?

I will close it and reopen it. It shouldnt be THAT heavy on memory.

--
“when things get difficult you just have to lie”

― Jean Claud Jüncker

Pages:123

rocksolid light 0.9.8
clearnet tor