Rocksolid Light

News from da outaworlds

mail  files  register  groups  login

Message-ID:  

BOFH excuse #337: the butane lighter causes the pincushioning


comp / comp.os.linux.misc / Re: Linux user doesn't seem to manage memory very well

SubjectAuthor
* Linux doesn't seem to manage memory very wellJames Harris
+* Re: Linux doesn't seem to manage memory very wellMarc Haber
|`* Re: Linux doesn't seem to manage memory very wellJames Harris
| +* Re: Linux doesn't seem to manage memory very wellMarc Haber
| |`* Re: Linux doesn't seem to manage memory very wellRich
| | `- Re: Linux doesn't seem to manage memory very wellMarc Haber
| `* Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
|  `- Re: Linux user doesn't seem to manage memory very wellCharlie Gibbs
+* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
|+- Re: Linux doesn't seem to manage memory very wellcandycanearter07
|+- Re: Linux doesn't seem to manage memory very wellLawrence D'Oliveiro
|`* Re: Linux doesn't seem to manage memory very wellJames Harris
| +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |`- Re: Linux doesn't seem to manage memory very wellcandycanearter07
| `- Re: Linux doesn't seem to manage memory very wellJoerg Walther
+* Re: Linux doesn't seem to manage memory very wellDavid W. Hodgins
|`* Re: Linux doesn't seem to manage memory very wellJames Harris
| +- Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| +- Re: Linux doesn't seem to manage memory very wellDavid W. Hodgins
| `- Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
+* Re: Linux doesn't seem to manage memory very wellLew Pitcher
|`* Re: Linux doesn't seem to manage memory very wellKenny McCormack
| +* Re: Linux doesn't seem to manage memory very wellRichard Kettlewell
| |+- Re: Linux doesn't seem to manage memory very wellLawrence D'Oliveiro
| |`* Re: Linux doesn't seem to manage memory very wellMarc Haber
| | `- Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| +* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |+- Re: Linux doesn't seem to manage memory very wellMarc Haber
| |`* Re: Linux doesn't seem to manage memory very wellJames Harris
| | `* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |  `* Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |   +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |   |`* Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |   | `* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |   |  `- Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |   `* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |    `* Re: Linux doesn't seem to manage memory very wellComputer Nerd Kev
| |     +- Re: Linux doesn't seem to manage memory very wellCarlos E.R.
| |     +* Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
| |     |`- Re: Linux user doesn't seem to manage memory very wellComputer Nerd Kev
| |     +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |     |`* Re: Linux doesn't seem to manage memory very wellcandycanearter07
| |     | `- Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
| |     `- Re: Linux doesn't seem to manage memory very wellcandycanearter07
| `* Re: Linux doesn't seem to manage memory very wellJames Harris
|  `* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
|   `* Re: Linux doesn't seem to manage memory very wellJames Harris
|    `* Re: Linux doesn't seem to manage memory very wellRichard Kettlewell
|     `- Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
+- Re: Linux doesn't seem to manage memory very wellMarco Moock
+* Re: Linux doesn't seem to manage memory very wellGrant Taylor
|+* Re: Linux doesn't seem to manage memory very wellcandycanearter07
||`* Re: Linux doesn't seem to manage memory very wellGrant Taylor
|| `* Re: Linux doesn't seem to manage memory very wellMarc Haber
||  `* Re: Linux doesn't seem to manage memory very wellLawrence D'Oliveiro
||   +- Re: Linux doesn't seem to manage memory very wellAndy Burns
||   +* Re: Linux doesn't seem to manage memory very wellThe Natural Philosopher
||   |`* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
||   | `- Re: Linux doesn't seem to manage memory very wellMarc Haber
||   +- Re: Linux doesn't seem to manage memory very wellMarc Haber
||   `* Re: Linux doesn't seem to manage memory very wellRich
||    `- Re: Linux doesn't seem to manage memory very wellCarlos E.R.
|`- Re: Linux doesn't seem to manage memory very wellJames Harris
+* Re: Linux doesn't seem to manage memory very wellD
|+- Re: Linux doesn't seem to manage memory very well26xh.0717
|`- Re: Linux doesn't seem to manage memory very well26xh.0717
+- Re: Linux user doesn't seem to manage memory very wellLawrence D'Oliveiro
`* Re: Linux doesn't seem to manage memory very wellCarlos E.R.
 +- Re: Linux doesn't seem to manage memory very wellRich
 `- Re: Linux doesn't seem to manage memory very wellJames Harris

Pages:123
Subject: Re: Linux doesn't seem to manage memory very well
From: Computer Nerd Kev
Newsgroups: comp.os.linux.misc
Organization: Ausics - https://newsgroups.ausics.net
Date: Fri, 3 May 2024 07:45 UTC
References: 1 2 3 4 5 6 7 8
Message-ID: <66349622@news.ausics.net>
From: not@telling.you.invalid (Computer Nerd Kev)
Subject: Re: Linux doesn't seem to manage memory very well
Newsgroups: comp.os.linux.misc
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me> <v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor> <v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor> <6634207d@news.ausics.net> <v11ulq$cmde$1@dont-email.me>
User-Agent: tin/2.0.1-20111224 ("Achenvoir") (UNIX) (Linux/2.4.31 (i686))
NNTP-Posting-Host: news.ausics.net
Date: 3 May 2024 17:45:38 +1000
Organization: Ausics - https://newsgroups.ausics.net
Lines: 44
X-Complaints: abuse@ausics.net
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!news.bbs.nz!news.ausics.net!not-for-mail
View all headers

The Natural Philosopher <tnp@invalid.invalid> wrote:
> On 03/05/2024 00:23, Computer Nerd Kev wrote:
>> I run current Firefox on a PC with 2GB RAM
>> and I don't have it getting killed by the kernel, nor do I have
>> problems with kernel crashes/reboots. I've also tried running
>> recent Firefox on a PC with 512MB RAM and noticed that it performs
>> much worse than with 2GB RAM, slowing down to a crawl while loading
>> some websites, suggesting that it really does need more RAM in that
>> case.
>>
>> I don't use web browsers to play video. If you're streaming super
>> high resolution video through your browser with the latest and
>> greatest compression algorithms, then it probably has the right
>> to chew up a lot of RAM.
>>
> I use browsers to play videos. RAM usage is not massive. CPU usage is.

Perhaps RAM usage isn't that great on the scale of systems with tens
of GB of RAM. Compared to 2GB I think it may be significant because
when I tried to transcode a 1920x1080 video in AV1 format to
lower-res MPEG4 on a VPS with 1GB RAM + 1GB swap space, ffmpeg
(v. 4) surprised me by running out of RAM. Of course it could be a
bug in that decoder, but not having tackled much AV1 video before I
concluded that high resolutions plus modern video codecs requires
lots of RAM.

> What chews memory are *commercial* websites loaded with (deliberately)
> buggy javaScript that cause javaScript engines to go into meltdown. How
> that is handled is browser dependent.
>
> Ublock Origin helps massively, but is not a complete answer.
> What is a massive help at leats in Mint Mate is the System Monitor
> widget that I keep in the task bar permanently displaying CPU, RAM and
> Network usage as teeny graphs.
> It is very easy to see when memory is all grabbed by a process rather
> than simply cache
> And monitor how much gets released when you close a website page.

There's also about:performance in Firefox. I do use NoScript with
all my browsing in Firefox.

--
__ __
#_ < |\| |< _#

Subject: Re: Linux doesn't seem to manage memory very well
From: James Harris
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Fri, 3 May 2024 07:59 UTC
References: 1 2 3 4 5
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: james.harris.1@gmail.com (James Harris)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 08:59:40 +0100
Organization: A noiseless patient Spider
Lines: 31
Message-ID: <v125hd$duau$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <v106b4$3sg37$5@dont-email.me>
<v11u0c$celj$3@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
Injection-Date: Fri, 03 May 2024 09:59:41 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="dd321ca2c5d88d785ae2cfb2ce34d280";
logging-data="457054"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19Sgru16lYx7w/NY3Kkq6LOEWZ3B+lD9Ss="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:uK0B9m67K9kBTl/HWT3xsz46b2o=
Content-Language: en-GB
In-Reply-To: <v11u0c$celj$3@dont-email.me>
View all headers

On 03/05/2024 06:51, The Natural Philosopher wrote:
> On 02/05/2024 15:01, James Harris wrote:
>> On 01/05/2024 21:42, Kenny McCormack wrote:
>>> In article <v0tkdc$3780t$1@dont-email.me>,
>>> Lew Pitcher  <lew.pitcher@digitalfreehold.ca> wrote:
>>>> On Wed, 01 May 2024 11:32:18 +0100, James Harris wrote:
>>>>
>>>>> Not a question, just an observation.
>>> ...
>>>>
>>>> So, if you want help, how about providing some details.
>>>
>>> OP was pretty clear that he was *not* seeking help.
>>
>> Correct. I don't want to overtax the expert assistance that's clearly
>> available from posters to this newsgroup and would rather ask for help
>> relatively rarely, so I am not looking (at least, yet!) for a
>> solution. My point, in this thread, was, instead, to comment on what I
>> perceive to be an OS-design issue - a long-term interest.
>>
>>
> In short anti-linux trolling.

Nope. Posting to a discussion forum to have a discussion about a point
of interest.

--
James Harris

Subject: Re: Linux doesn't seem to manage memory very well
From: Joerg Walther
Newsgroups: comp.os.linux.misc
Organization: Easynews - www.easynews.com
Date: Fri, 3 May 2024 09:40 UTC
References: 1 2 3
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!usenet.blueworldhosting.com!diablo1.usenet.blueworldhosting.com!peer03.iad!feed-me.highwinds-media.com!news.highwinds-media.com!fx06.iad.POSTED!not-for-mail
From: joerg.walther@magenta.de (Joerg Walther)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Message-ID: <31c93jp73d9vb2drql2iirdu98v4nqu0s8@joergwalther.my-fqdn.de>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6vp$34adu$1@dont-email.me> <v105n4$3sg37$3@dont-email.me>
X-Newsreader: Forte Agent 6.00/32.1186
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Lines: 16
X-Complaints-To: abuse@easynews.com
Organization: Easynews - www.easynews.com
X-Complaints-Info: Please be sure to forward a copy of ALL headers otherwise we will be unable to process your complaint properly.
Date: Fri, 03 May 2024 11:40:30 +0200
X-Received-Bytes: 1460
View all headers

James Harris wrote:

>It may not be a memory leak but it's certainly a rogue program -
>chrome/chromium in this case, though I've had similar and worse problems
>with Firefox which seems to me more likely to have a genuine memory leak.

I had the issue with Chrome (not with Chromium) that when streaming
videos it would take as much RAM as the video size was in total, so one
browser tab could easily eat up a couple of GB of memory. I then
switched to Chromium, which didn't have this issue. This was probably 6
months ago, so I do not know whether current versions of Chrome still
have his issue (Ubuntu here).

-jw-
--
And now for something completely different...

Subject: Re: Linux doesn't seem to manage memory very well
From: Carlos E.R.
Newsgroups: comp.os.linux.misc
Date: Fri, 3 May 2024 11:38 UTC
References: 1 2 3 4 5 6 7
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: robin_listas@es.invalid (Carlos E.R.)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 13:38:00 +0200
Lines: 67
Message-ID: <otuegkxjmk.ln2@Telcontar.valinor>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Trace: individual.net PT3whBqGqhXBEhZHIbiPZgK5iWjLWXg2icll5YhPomNIc1akHw
X-Orig-Path: Telcontar.valinor!not-for-mail
Cancel-Lock: sha1:Z4+DZxPbaSt+eJzaRi0+I8or7V8= sha256:v+Tfe+XYMkIFOOqbWrl0R0lp7RreMeJOP7/g2L8NmbQ=
User-Agent: Mozilla Thunderbird
Content-Language: es-ES, en-CA
In-Reply-To: <6634207d@news.ausics.net>
View all headers

On 2024-05-03 01:23, Computer Nerd Kev wrote:
> Carlos E.R. <robin_listas@es.invalid> wrote:
>> On 2024-05-02 16:06, James Harris wrote:
>>>
>>> Yes, I am (at least tentatively) blaming Linux but not for the problem
>>> you think. I wouldn't expect Linux to prevent programs from gobbling up
>>> memory but I would expect it to manage memory hogs more gracefully than
>>> it does. IME Windows handles the same situation better - and that may be
>>> down to the different designs of their paging systems.
>>>
>>> Don't get me wrong. I much prefer Linux to Windows and have often seen
>>> Windows get into a worse situation under different circumstances. But
>>> for page management ISTM that the design of Linux's paging subsystem may
>>> not be the best.
>>
>> You can configure Linux to crash the application that is behaving badly
>> by grabbing all the memory. It is up to you, the boss.
>>
>> The philosophy is not to nanny care for you. It does what you asked.
>> More memory? Yes sir. Till death does us part. Your orders will be obeyed.
>>
>> :-)
>
> I didn't know there was an option not to have it do that (via the
> Out Of Memory Reaper). It seems the alternatives are to reboot or
> risk the kernel crashing, so your description seems about right.
>
> https://www.oracle.com/technical-resources/articles/it-infrastructure/dev-oom-killer.html
>
> The OP has noted now that the process that consumes their RAM is
> Chrome or Firefox. I've not seen a detailed description of why it
> happens, but I've long noted that Firefox seems to expand its RAM
> usage to the available space, but different from a memory leak in
> that it usually leaves a certain amount free. I assume that this
> in intended behaviour. I run current Firefox on a PC with 2GB RAM
> and I don't have it getting killed by the kernel, nor do I have
> problems with kernel crashes/reboots. I've also tried running
> recent Firefox on a PC with 512MB RAM and noticed that it performs
> much worse than with 2GB RAM, slowing down to a crawl while loading
> some websites, suggesting that it really does need more RAM in that
> case.

Firefox uses a lot of memory.

One problem is memory fragmentation. It reserves many chunks then
eventually frees many, but they may not being contiguous, so maybe they
can not be reused, so it requests more memory.

When I started using Linux, back in 1998, I did notice that Linux needed
more memory than Windows to work right. I had to improve my hardware
because of that. My previous computer had 8 GB and it was not enough, it
was swapping. So now I have a machine with 64.

>
> I don't use web browsers to play video.

No youtube? :-)

> If you're streaming super
> high resolution video through your browser with the latest and
> greatest compression algorithms, then it probably has the right
> to chew up a lot of RAM.
>

--
Cheers, Carlos.

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Fri, 3 May 2024 12:37 UTC
References: 1 2 3 4 5 6 7 8 9
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 3 May 2024 13:37:41 +0100
Organization: A little, after lunch
Lines: 54
Message-ID: <v12lql$ht4j$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <v11ulq$cmde$1@dont-email.me>
<66349622@news.ausics.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Fri, 03 May 2024 14:37:41 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="4ce65002836e8d723e70c42918b10bd5";
logging-data="586899"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX18YETNNkXu4ImPOgLXe0ds4xvYAMThpqM8="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:93mcFN+BWx4ysDnQEXApN0vcJyE=
In-Reply-To: <66349622@news.ausics.net>
Content-Language: en-GB
View all headers

On 03/05/2024 08:45, Computer Nerd Kev wrote:
> The Natural Philosopher <tnp@invalid.invalid> wrote:
>> On 03/05/2024 00:23, Computer Nerd Kev wrote:
>>> I run current Firefox on a PC with 2GB RAM
>>> and I don't have it getting killed by the kernel, nor do I have
>>> problems with kernel crashes/reboots. I've also tried running
>>> recent Firefox on a PC with 512MB RAM and noticed that it performs
>>> much worse than with 2GB RAM, slowing down to a crawl while loading
>>> some websites, suggesting that it really does need more RAM in that
>>> case.
>>>
>>> I don't use web browsers to play video. If you're streaming super
>>> high resolution video through your browser with the latest and
>>> greatest compression algorithms, then it probably has the right
>>> to chew up a lot of RAM.
>>>
>> I use browsers to play videos. RAM usage is not massive. CPU usage is.
>
> Perhaps RAM usage isn't that great on the scale of systems with tens
> of GB of RAM. Compared to 2GB I think it may be significant because
> when I tried to transcode a 1920x1080 video in AV1 format to
> lower-res MPEG4 on a VPS with 1GB RAM + 1GB swap space, ffmpeg
> (v. 4) surprised me by running out of RAM. Of course it could be a
> bug in that decoder, but not having tackled much AV1 video before I
> concluded that high resolutions plus modern video codecs requires
> lots of RAM.
>
Transcoding is not playing

>> What chews memory are *commercial* websites loaded with (deliberately)
>> buggy javaScript that cause javaScript engines to go into meltdown. How
>> that is handled is browser dependent.
>>
>> Ublock Origin helps massively, but is not a complete answer.
>> What is a massive help at leats in Mint Mate is the System Monitor
>> widget that I keep in the task bar permanently displaying CPU, RAM and
>> Network usage as teeny graphs.
>> It is very easy to see when memory is all grabbed by a process rather
>> than simply cache
>> And monitor how much gets released when you close a website page.
>
> There's also about:performance in Firefox. I do use NoScript with
> all my browsing in Firefox.

I haven't yet needed to

>

--
Renewable energy: Expensive solutions that don't work to a problem that
doesn't exist instituted by self legalising protection rackets that
don't protect, masquerading as public servants who don't serve the public.

Subject: Re: Linux doesn't seem to manage memory very well
From: Richard Kettlewell
Newsgroups: comp.os.linux.misc
Organization: terraraq NNTP server
Date: Fri, 3 May 2024 15:23 UTC
References: 1 2 3 4 5 6
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!news.gegeweb.eu!gegeweb.org!nntp.terraraq.uk!.POSTED.tunnel.sfere.anjou.terraraq.org.uk!not-for-mail
From: invalid@invalid.invalid (Richard Kettlewell)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Fri, 03 May 2024 16:23:02 +0100
Organization: terraraq NNTP server
Message-ID: <wwvjzkagbs9.fsf@LkoBDZeT.terraraq.uk>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <v106b4$3sg37$5@dont-email.me>
<v11u0c$celj$3@dont-email.me> <v125hd$duau$1@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Injection-Info: innmantic.terraraq.uk; posting-host="tunnel.sfere.anjou.terraraq.org.uk:172.17.207.6";
logging-data="28401"; mail-complaints-to="usenet@innmantic.terraraq.uk"
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
Cancel-Lock: sha1:0Or7XbRyvrTLuM5YgjM7tTX/59o=
X-Face: h[Hh-7npe<<b4/eW[]sat,I3O`t8A`(ej.H!F4\8|;ih)`7{@:A~/j1}gTt4e7-n*F?.Rl^
F<\{jehn7.KrO{!7=:(@J~]<.[{>v9!1<qZY,{EJxg6?Er4Y7Ng2\Ft>Z&W?r\c.!4DXH5PWpga"ha
+r0NzP?vnz:e/knOY)PI-
X-Boydie: NO
View all headers

James Harris <james.harris.1@gmail.com> writes:
> On 03/05/2024 06:51, The Natural Philosopher wrote:
>> In short anti-linux trolling.
>
> Nope. Posting to a discussion forum to have a discussion about a point
> of interest.

There’s not really enough in the original posting for anyone to have an
informed discussion, though.

--
https://www.greenend.org.uk/rjk/

Subject: Re: Linux user doesn't seem to manage memory very well
From: Charlie Gibbs
Newsgroups: comp.os.linux.misc
Date: Fri, 3 May 2024 19:32 UTC
References: 1 2 3 4
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!usenet.blueworldhosting.com!diablo1.usenet.blueworldhosting.com!peer03.iad!feed-me.highwinds-media.com!news.highwinds-media.com!fx06.iad.POSTED!not-for-mail
Newsgroups: comp.os.linux.misc
From: cgibbs@kltpzyxm.invalid (Charlie Gibbs)
Subject: Re: Linux user doesn't seem to manage memory very well
References: <v0t5nk$3415a$1@dont-email.me> <v0t6ia$6arr$1@news1.tnib.de>
<v105hc$3sg37$2@dont-email.me> <v11fo3$9q5g$1@dont-email.me>
User-Agent: slrn/1.0.3 (Linux)
Lines: 25
Message-ID: <JZaZN.28027$ocy9.1007@fx06.iad>
X-Complaints-To: https://www.astraweb.com/aup
NNTP-Posting-Date: Fri, 03 May 2024 19:32:57 UTC
Date: Fri, 03 May 2024 19:32:57 GMT
X-Received-Bytes: 1836
View all headers

On 2024-05-03, Lawrence D'Oliveiro <ldo@nz.invalid> wrote:

> On Thu, 2 May 2024 14:47:24 +0100, James Harris wrote:
>
>> A number of years ago
>> I came up with what I thought was a sensible design for a paging system.
>> I later found that it corresponded very closely to the one used in
>> Windows and differed markedly from the paging system used in Linux. I
>> remember thinking that the latter was not a good design ...
>
> Look at all the effort those smart Microsoft engineers had to go to,
> just to get Windows file copying to work properly:
> <https://techcommunity.microsoft.com/t5/windows-blog-archive/inside-vista-sp1-file-copy-improvements/ba-p/723622>

Sounds like a lot of gratuitous complexity, aggravated by their penchant
for lying about when something is done. But M$ file copying issues are
nothing new - many of us still remember being stung by the MS-DOS COPY
command's refusal to copy a zero-length file (although it still deleted
a like-named file at the destination if it existed).

--
/~\ Charlie Gibbs | Microsoft is a dictatorship.
\ / <cgibbs@kltpzyxm.invalid> | Apple is a cult.
X I'm really at ac.dekanfrus | Linux is anarchy.
/ \ if you read it the right way. | Pick your poison.

Subject: Re: Linux user doesn't seem to manage memory very well
From: Lawrence D'Oliv
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Fri, 3 May 2024 22:12 UTC
References: 1 2 3 4 5 6 7
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: ldo@nz.invalid (Lawrence D'Oliveiro)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux user doesn't seem to manage memory very well
Date: Fri, 3 May 2024 22:12:27 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 6
Message-ID: <v13ngb$p9ih$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <v106b4$3sg37$5@dont-email.me>
<v11u0c$celj$3@dont-email.me> <v125hd$duau$1@dont-email.me>
<wwvjzkagbs9.fsf@LkoBDZeT.terraraq.uk>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Sat, 04 May 2024 00:12:27 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="3e71a75fbbcf81b4a78150d90a6a33ff";
logging-data="829009"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/rqabxyYaDhatZzyT7gfsl"
User-Agent: Pan/0.155 (Kherson; fc5a80b8)
Cancel-Lock: sha1:s9936aep2rZDG2Hc6urInpNCPzI=
View all headers

On Fri, 03 May 2024 16:23:02 +0100, Richard Kettlewell wrote:

> There’s not really enough in the original posting for anyone to have an
> informed discussion, though.

Which is the point of trolling, isn’t it?

Subject: Re: Linux doesn't seem to manage memory very well
From: Computer Nerd Kev
Newsgroups: comp.os.linux.misc
Organization: Ausics - https://newsgroups.ausics.net
Date: Fri, 3 May 2024 23:21 UTC
References: 1 2 3 4 5 6 7 8 9 10
Message-ID: <6635717d@news.ausics.net>
From: not@telling.you.invalid (Computer Nerd Kev)
Subject: Re: Linux doesn't seem to manage memory very well
Newsgroups: comp.os.linux.misc
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me> <v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor> <v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor> <6634207d@news.ausics.net> <v11ulq$cmde$1@dont-email.me> <66349622@news.ausics.net> <v12lql$ht4j$1@dont-email.me>
User-Agent: tin/2.0.1-20111224 ("Achenvoir") (UNIX) (Linux/2.4.31 (i586))
NNTP-Posting-Host: news.ausics.net
Date: 4 May 2024 09:21:34 +1000
Organization: Ausics - https://newsgroups.ausics.net
Lines: 34
X-Complaints: abuse@ausics.net
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!news.bbs.nz!news.ausics.net!not-for-mail
View all headers

The Natural Philosopher <tnp@invalid.invalid> wrote:
> On 03/05/2024 08:45, Computer Nerd Kev wrote:
>> The Natural Philosopher <tnp@invalid.invalid> wrote:
>>> On 03/05/2024 00:23, Computer Nerd Kev wrote:
>>>> I don't use web browsers to play video. If you're streaming super
>>>> high resolution video through your browser with the latest and
>>>> greatest compression algorithms, then it probably has the right
>>>> to chew up a lot of RAM.
>>>>
>>> I use browsers to play videos. RAM usage is not massive. CPU usage is.
>>
>> Perhaps RAM usage isn't that great on the scale of systems with tens
>> of GB of RAM. Compared to 2GB I think it may be significant because
>> when I tried to transcode a 1920x1080 video in AV1 format to
>> lower-res MPEG4 on a VPS with 1GB RAM + 1GB swap space, ffmpeg
>> (v. 4) surprised me by running out of RAM. Of course it could be a
>> bug in that decoder, but not having tackled much AV1 video before I
>> concluded that high resolutions plus modern video codecs requires
>> lots of RAM.
>>
> Transcoding is not playing

They both involve decoding. I converted other HD video to the same
output format without RAM issues, so the difference was the input
format, decoding the AV1 video, which applies to playback and
transcoding. Maybe it was a bug in ffmpeg, but as I haven't seen
benchmarks for memory usage online so I concluded from my own
experience. After a recent OS upgrade the VPS now has ffmpeg 5
installed, so I'll see what happens next time some AV1 video comes
my way.

--
__ __
#_ < |\| |< _#

Subject: Re: Linux doesn't seem to manage memory very well
From: Computer Nerd Kev
Newsgroups: comp.os.linux.misc
Organization: Ausics - https://newsgroups.ausics.net
Date: Sat, 4 May 2024 00:13 UTC
References: 1 2 3 4 5 6 7 8
Message-ID: <66357da6@news.ausics.net>
From: not@telling.you.invalid (Computer Nerd Kev)
Subject: Re: Linux doesn't seem to manage memory very well
Newsgroups: comp.os.linux.misc
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me> <v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor> <v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor> <6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
User-Agent: tin/2.0.1-20111224 ("Achenvoir") (UNIX) (Linux/2.4.31 (i586))
NNTP-Posting-Host: news.ausics.net
Date: 4 May 2024 10:13:26 +1000
Organization: Ausics - https://newsgroups.ausics.net
Lines: 63
X-Complaints: abuse@ausics.net
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!news.bbs.nz!news.ausics.net!not-for-mail
View all headers

Carlos E.R. <robin_listas@es.invalid> wrote:
> On 2024-05-03 01:23, Computer Nerd Kev wrote:
>>
>> The OP has noted now that the process that consumes their RAM is
>> Chrome or Firefox. I've not seen a detailed description of why it
>> happens, but I've long noted that Firefox seems to expand its RAM
>> usage to the available space, but different from a memory leak in
>> that it usually leaves a certain amount free. I assume that this
>> in intended behaviour. I run current Firefox on a PC with 2GB RAM
>> and I don't have it getting killed by the kernel, nor do I have
>> problems with kernel crashes/reboots. I've also tried running
>> recent Firefox on a PC with 512MB RAM and noticed that it performs
>> much worse than with 2GB RAM, slowing down to a crawl while loading
>> some websites, suggesting that it really does need more RAM in that
>> case.
>
> Firefox uses a lot of memory.
>
> One problem is memory fragmentation. It reserves many chunks then
> eventually frees many, but they may not being contiguous, so maybe they
> can not be reused, so it requests more memory.

It seems to me like it looks at the available RAM (not including
swap space) and only works at freeing space when the free RAM
remaining gets to a certain size/percentage. Increading RAM because
one feels there isn't enough space free therefore isn't really a
solution because Firefox will eventually expand to fill that new
space too. Although if it tries to leave a minimum percentage free,
the size of that minimum would increase.

But it would be great to see an explanation of how it really works
from one of the Firefox developers (one can dream).

> When I started using Linux, back in 1998, I did notice that Linux needed
> more memory than Windows to work right.

It did compared to mid-90s Windows. With XP and later the
difference switched the other way and it surprises me how much more
RAM Windows 10 can use doing nothing compared to ~100MB used after
modern Linux boots up with to a lightweight desktop. Older Linux
used much RAM less than that, but still more than a basic Win98
installation (the old PC I'm posting from with 80MB RAM dual-boots
to either).

> I had to improve my hardware
> because of that. My previous computer had 8 GB and it was not enough, it
> was swapping. So now I have a machine with 64.

I wouldn't know what to do with 8GB (well I know some people like
to run lots of VMs, but that's too much to think about in my
opinion).

>> I don't use web browsers to play video.
>
> No youtube? :-)

Only with youtube-dl (yes I know there's also the yt-dlp fork). To
find videos there I also avoid their Javascript-filled website and
use Invidious as well as "site:youtube.com" in DuckDuckGo.

--
__ __
#_ < |\| |< _#

Subject: Re: Linux doesn't seem to manage memory very well
From: Carlos E.R.
Newsgroups: comp.os.linux.misc
Date: Sat, 4 May 2024 00:34 UTC
References: 1 2 3 4 5 6 7 8 9
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!fu-berlin.de!uni-berlin.de!individual.net!not-for-mail
From: robin_listas@es.invalid (Carlos E.R.)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Sat, 4 May 2024 02:34:00 +0200
Lines: 42
Message-ID: <occggkxngg.ln2@Telcontar.valinor>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
<66357da6@news.ausics.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Trace: individual.net 5SJEzW/NuEPxS3xmiO/rtgaDJYP979O20MTGhpnc3eWTTOcjvG
X-Orig-Path: Telcontar.valinor!not-for-mail
Cancel-Lock: sha1:NJgrnd33s48cF/cc+u0RC3QnHAk= sha256:Cfb/zJLMFpeTgRYvqAXchYqpLb29dJwJ1VwaNZJ1M0o=
User-Agent: Mozilla Thunderbird
Content-Language: es-ES, en-CA
In-Reply-To: <66357da6@news.ausics.net>
View all headers

On 2024-05-04 02:13, Computer Nerd Kev wrote:
> Carlos E.R. <robin_listas@es.invalid> wrote:
>> On 2024-05-03 01:23, Computer Nerd Kev wrote:
>>>
>>> The OP has noted now that the process that consumes their RAM is
>>> Chrome or Firefox. I've not seen a detailed description of why it
>>> happens, but I've long noted that Firefox seems to expand its RAM
>>> usage to the available space, but different from a memory leak in
>>> that it usually leaves a certain amount free. I assume that this
>>> in intended behaviour. I run current Firefox on a PC with 2GB RAM
>>> and I don't have it getting killed by the kernel, nor do I have
>>> problems with kernel crashes/reboots. I've also tried running
>>> recent Firefox on a PC with 512MB RAM and noticed that it performs
>>> much worse than with 2GB RAM, slowing down to a crawl while loading
>>> some websites, suggesting that it really does need more RAM in that
>>> case.
>>
>> Firefox uses a lot of memory.
>>
>> One problem is memory fragmentation. It reserves many chunks then
>> eventually frees many, but they may not being contiguous, so maybe they
>> can not be reused, so it requests more memory.
>
> It seems to me like it looks at the available RAM (not including
> swap space) and only works at freeing space when the free RAM
> remaining gets to a certain size/percentage. Increading RAM because
> one feels there isn't enough space free therefore isn't really a
> solution because Firefox will eventually expand to fill that new
> space too. Although if it tries to leave a minimum percentage free,
> the size of that minimum would increase.
>
> But it would be great to see an explanation of how it really works
> from one of the Firefox developers (one can dream).

If memory serves, my explanation above comes from a Chrome dev,
distorted through years of retelling it ;-)

....

--
Cheers, Carlos.

Subject: Re: Linux user doesn't seem to manage memory very well
From: Lawrence D'Oliv
Newsgroups: comp.os.linux.misc
Organization: A noiseless patient Spider
Date: Sat, 4 May 2024 01:12 UTC
References: 1 2 3 4 5 6 7 8 9
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: ldo@nz.invalid (Lawrence D'Oliveiro)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux user doesn't seem to manage memory very well
Date: Sat, 4 May 2024 01:12:14 -0000 (UTC)
Organization: A noiseless patient Spider
Lines: 6
Message-ID: <v1421d$rcfn$3@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
<66357da6@news.ausics.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
Injection-Date: Sat, 04 May 2024 03:12:14 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="3e71a75fbbcf81b4a78150d90a6a33ff";
logging-data="897527"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/J06lOgYBNZoomIDfRYwZ6"
User-Agent: Pan/0.155 (Kherson; fc5a80b8)
Cancel-Lock: sha1:5YXQjSH+b0faGCDrbMm1D1LHHOI=
View all headers

On 4 May 2024 10:13:26 +1000, Computer Nerd Kev wrote:

> ... as well as "site:youtube.com" in DuckDuckGo.

Hey, does that work? Because I think Google dropped support for it a while
back.

Subject: Re: Linux user doesn't seem to manage memory very well
From: Computer Nerd Kev
Newsgroups: comp.os.linux.misc
Organization: Ausics - https://newsgroups.ausics.net
Date: Sat, 4 May 2024 01:58 UTC
References: 1 2 3 4 5 6 7 8 9 10
Message-ID: <66359658@news.ausics.net>
From: not@telling.you.invalid (Computer Nerd Kev)
Subject: Re: Linux user doesn't seem to manage memory very well
Newsgroups: comp.os.linux.misc
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me> <v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor> <v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor> <6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor> <66357da6@news.ausics.net> <v1421d$rcfn$3@dont-email.me>
User-Agent: tin/2.0.1-20111224 ("Achenvoir") (UNIX) (Linux/2.4.31 (i586))
NNTP-Posting-Host: news.ausics.net
Date: 4 May 2024 11:58:48 +1000
Organization: Ausics - https://newsgroups.ausics.net
Lines: 18
X-Complaints: abuse@ausics.net
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!news.bbs.nz!news.ausics.net!not-for-mail
View all headers

Lawrence D'Oliveiro <ldo@nz.invalid> wrote:
> On 4 May 2024 10:13:26 +1000, Computer Nerd Kev wrote:
>
>> ... as well as "site:youtube.com" in DuckDuckGo.
>
> Hey, does that work?

Sure, I'm using it more and more for websites where their own
search doesn't work without Javascript.

> Because I think Google dropped support for it a while back.

Searching for "Linux memory management site:youtube.com" works for
me right now with DDG and Google.

--
__ __
#_ < |\| |< _#

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Sat, 4 May 2024 09:48 UTC
References: 1 2 3 4 5 6 7 8 9
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Sat, 4 May 2024 10:48:04 +0100
Organization: A little, after lunch
Lines: 54
Message-ID: <v1508k$14plg$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
<66357da6@news.ausics.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Sat, 04 May 2024 11:48:04 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="1e01a0fe14ad8eb7f3981eea5d4a55ec";
logging-data="1205936"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19/RQNKG1sNW3xjYihb4zSBUGwSsjKrLeU="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:Ihc5uYo8llqRAe1cbPlD8EX8ZpU=
In-Reply-To: <66357da6@news.ausics.net>
Content-Language: en-GB
View all headers

On 04/05/2024 01:13, Computer Nerd Kev wrote:
> I wouldn't know what to do with 8GB (well I know some people like
> to run lots of VMs, but that's too much to think about in my
> opinion).

Once you run a GUI and some modern python style code its amazing how
much ram crap apps can gobble up

I just upgraded from 8GB because the combination of 3GB of windows VM
plus a browser running a 3D printers webserver with embedded video, plus
a Python 3D slicer overwhelmed the machine and sent it into swap.

Firefox seems to spawn an infinite number of 'webkit' and 'isolated web
company' children

Especially with necessary ad blockers installed

Thunderbird is over half a GB

Orca slicer is 400GB+

Plus two instances of a linux game I am playing takes *hard* usage to
over 8GB/ I.e before cached files etc.

Now these are all things I want to do *at the same time*. Edit in
windows VM, pass 3D files to the slicer, monitor print progress via the
web interface, and play a linux game to while away the minutes waiting
for the 3D printer to turn out yet another 'close, but no cigar' print
that needs re-editing. Or while reading the news^H^H^H^H propaganda, or
Usenet, or getting email in.

All I can say is, thank Clapton Linux has a really good memory manager.

$ free -m
total used free shared buff/cache
available
Mem: 23909 7385 931 1044 15592
15090
Swap: 2047 0 2047

I can't control 3rd party apps, but I can control my machine's memory.

Up till buying a 3D printer 8GB was more than enough, but the constant
use of windows based 3D and 2D CAD programs plus the slicer and
firefoxes latest bloatery has taken it over the edge

--
For every complex problem there is an answer that is clear, simple, and
wrong.

H.L.Mencken

Subject: Re: Linux doesn't seem to manage memory very well
From: candycanearter07
Newsgroups: comp.os.linux.misc
Organization: the-candyden-of-code
Date: Mon, 6 May 2024 15:30 UTC
References: 1 2 3 4
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: candycanearter07@candycanearter07.nomail.afraid (candycanearter07)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Mon, 6 May 2024 15:30:10 -0000 (UTC)
Organization: the-candyden-of-code
Lines: 40
Message-ID: <v1at22$2ksi4$1@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0t6vp$34adu$1@dont-email.me>
<v105n4$3sg37$3@dont-email.me> <v11tq1$celj$1@dont-email.me>
Injection-Date: Mon, 06 May 2024 17:30:11 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="3c94488543f3db0588716d9974cba4a5";
logging-data="2781764"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/hiw/TjXTlN6P7vEiI+XZ8Gz9EJNUFOgWWdFPKNEyaMA=="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:hmL+WQe9eu98lbEFEjS+tf5FKAw=
X-Face: b{dPmN&%4|lEo,wUO\"KLEOu5N_br(N2Yuc5/qcR5i>9-!^e\.Tw9?/m0}/~:UOM:Zf]%
b+ V4R8q|QiU/R8\|G\WpC`-s?=)\fbtNc&=/a3a)r7xbRI]Vl)r<%PTriJ3pGpl_/B6!8pe\btzx
`~R! r3.0#lHRE+^Gro0[cjsban'vZ#j7,?I/tHk{s=TFJ:H?~=]`O*~3ZX`qik`b:.gVIc-[$t/e
ZrQsWJ >|l^I_[pbsIqwoz.WGA]<D
View all headers

The Natural Philosopher <tnp@invalid.invalid> wrote at 05:47 this Friday (GMT):
> On 02/05/2024 14:50, James Harris wrote:
>> On 01/05/2024 11:53, The Natural Philosopher wrote:
>>> On 01/05/2024 11:32, James Harris wrote:
>>>> Not a question, just an observation.
>>>>
>>>> I say that Linux doesn't seem to handle memory well because my laptop
>>>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>>>> for a similar workload). Under Linux the RAM would fill up and then
>>>> swap space would be used. Then the machine would become largely
>>>> unresponsive - e.g. taking minutes to switch between windows.
>>>>
>>>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)!
>>>> But even so, RAM has still steadily filled up until reaching the full
>>>> 24GB. What's more, it's now showing 4.8GB of swap space in use.
>>>>
>>>>
>>> That's not Linux. That's a rogue program with a memory leak...
>>
>> It may not be a memory leak but it's certainly a rogue program -
>> chrome/chromium in this case, though I've had similar and worse problems
>> with Firefox which seems to me more likely to have a genuine memory leak.
>>
>> However, the point of the original post was to vent a frustration about
>> the way that Linux handles such memory deletion when it happens.
>>
>>
> It is not hard to write a javascript program that eats all memory and
> place it on a website.
>
> I even encountered a website that silently ran some sort of proxy server
> in my browser and used up all my upload bandwidth.
>
>
> Linux at least protects you from such sites having root access by default...

I think sandboxing is /supposed/ to protect you from that.
--
user <candycane> is generated from /dev/urandom

Subject: Re: Linux doesn't seem to manage memory very well
From: candycanearter07
Newsgroups: comp.os.linux.misc
Organization: the-candyden-of-code
Date: Mon, 6 May 2024 15:30 UTC
References: 1 2 3 4 5 6 7 8 9 10
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: candycanearter07@candycanearter07.nomail.afraid (candycanearter07)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Mon, 6 May 2024 15:30:11 -0000 (UTC)
Organization: the-candyden-of-code
Lines: 53
Message-ID: <v1at23$2ksi4$2@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
<66357da6@news.ausics.net> <v1508k$14plg$1@dont-email.me>
Injection-Date: Mon, 06 May 2024 17:30:11 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="3c94488543f3db0588716d9974cba4a5";
logging-data="2781764"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX19FE2naD9/IqDe4mAj2BljORSWsaK1cKsQ02pWzWVIN7Q=="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:E1CA83jBSSQSnfOxomKI2tSzq58=
X-Face: b{dPmN&%4|lEo,wUO\"KLEOu5N_br(N2Yuc5/qcR5i>9-!^e\.Tw9?/m0}/~:UOM:Zf]%
b+ V4R8q|QiU/R8\|G\WpC`-s?=)\fbtNc&=/a3a)r7xbRI]Vl)r<%PTriJ3pGpl_/B6!8pe\btzx
`~R! r3.0#lHRE+^Gro0[cjsban'vZ#j7,?I/tHk{s=TFJ:H?~=]`O*~3ZX`qik`b:.gVIc-[$t/e
ZrQsWJ >|l^I_[pbsIqwoz.WGA]<D
View all headers

The Natural Philosopher <tnp@invalid.invalid> wrote at 09:48 this Saturday (GMT):
> On 04/05/2024 01:13, Computer Nerd Kev wrote:
>> I wouldn't know what to do with 8GB (well I know some people like
>> to run lots of VMs, but that's too much to think about in my
>> opinion).
>
> Once you run a GUI and some modern python style code its amazing how
> much ram crap apps can gobble up
>
> I just upgraded from 8GB because the combination of 3GB of windows VM
> plus a browser running a 3D printers webserver with embedded video, plus
> a Python 3D slicer overwhelmed the machine and sent it into swap.
>
> Firefox seems to spawn an infinite number of 'webkit' and 'isolated web
> company' children
>
> Especially with necessary ad blockers installed
>
> Thunderbird is over half a GB
>
> Orca slicer is 400GB+
>
> Plus two instances of a linux game I am playing takes *hard* usage to
> over 8GB/ I.e before cached files etc.
>
> Now these are all things I want to do *at the same time*. Edit in
> windows VM, pass 3D files to the slicer, monitor print progress via the
> web interface, and play a linux game to while away the minutes waiting
> for the 3D printer to turn out yet another 'close, but no cigar' print
> that needs re-editing. Or while reading the news^H^H^H^H propaganda, or
> Usenet, or getting email in.
>
> All I can say is, thank Clapton Linux has a really good memory manager.
>
>
> $ free -m
> total used free shared buff/cache
> available
> Mem: 23909 7385 931 1044 15592
> 15090
> Swap: 2047 0 2047
>
> I can't control 3rd party apps, but I can control my machine's memory.
>
> Up till buying a 3D printer 8GB was more than enough, but the constant
> use of windows based 3D and 2D CAD programs plus the slicer and
> firefoxes latest bloatery has taken it over the edge

Yeah, but what other JS-compatible browsers exist? Chromium is also bad
with memory..
--
user <candycane> is generated from /dev/urandom

Subject: Re: Linux doesn't seem to manage memory very well
From: candycanearter07
Newsgroups: comp.os.linux.misc
Organization: the-candyden-of-code
Date: Mon, 6 May 2024 15:30 UTC
References: 1 2 3 4 5 6 7 8 9
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: candycanearter07@candycanearter07.nomail.afraid (candycanearter07)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Mon, 6 May 2024 15:30:12 -0000 (UTC)
Organization: the-candyden-of-code
Lines: 16
Message-ID: <v1at23$2ksi4$3@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
<66357da6@news.ausics.net>
Injection-Date: Mon, 06 May 2024 17:30:12 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="3c94488543f3db0588716d9974cba4a5";
logging-data="2781764"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX18JNBDqDdZjrZ1WTAbq4d820DpF8rTmBwUGoKywq6IlEw=="
User-Agent: slrn/pre1.0.4-9 (Linux)
Cancel-Lock: sha1:JEUHVE/gun90BGZtwaeGpvc7wh8=
X-Face: b{dPmN&%4|lEo,wUO\"KLEOu5N_br(N2Yuc5/qcR5i>9-!^e\.Tw9?/m0}/~:UOM:Zf]%
b+ V4R8q|QiU/R8\|G\WpC`-s?=)\fbtNc&=/a3a)r7xbRI]Vl)r<%PTriJ3pGpl_/B6!8pe\btzx
`~R! r3.0#lHRE+^Gro0[cjsban'vZ#j7,?I/tHk{s=TFJ:H?~=]`O*~3ZX`qik`b:.gVIc-[$t/e
ZrQsWJ >|l^I_[pbsIqwoz.WGA]<D
View all headers

Computer Nerd Kev <not@telling.you.invalid> wrote at 00:13 this Saturday (GMT):
> Carlos E.R. <robin_listas@es.invalid> wrote:
>> On 2024-05-03 01:23, Computer Nerd Kev wrote:
[snip]
>>> I don't use web browsers to play video.
>>
>> No youtube? :-)
>
> Only with youtube-dl (yes I know there's also the yt-dlp fork). To
> find videos there I also avoid their Javascript-filled website and
> use Invidious as well as "site:youtube.com" in DuckDuckGo.

ytfzf is another good tool for YouTube downloading.
--
user <candycane> is generated from /dev/urandom

Subject: Re: Linux doesn't seem to manage memory very well
From: The Natural Philosop
Newsgroups: comp.os.linux.misc
Organization: A little, after lunch
Date: Mon, 6 May 2024 19:34 UTC
References: 1 2 3 4 5 6 7 8 9 10 11
Path: eternal-september.org!news.eternal-september.org!.POSTED!not-for-mail
From: tnp@invalid.invalid (The Natural Philosopher)
Newsgroups: comp.os.linux.misc
Subject: Re: Linux doesn't seem to manage memory very well
Date: Mon, 6 May 2024 20:34:51 +0100
Organization: A little, after lunch
Lines: 62
Message-ID: <v1bbcr$2oa0i$3@dont-email.me>
References: <v0t5nk$3415a$1@dont-email.me> <v0tkdc$3780t$1@dont-email.me>
<v0u9g9$f5jt$1@news.xmission.com> <pqmbgkxe9o.ln2@Telcontar.valinor>
<v106lv$3sg37$6@dont-email.me> <1gddgkxic6.ln2@Telcontar.valinor>
<6634207d@news.ausics.net> <otuegkxjmk.ln2@Telcontar.valinor>
<66357da6@news.ausics.net> <v1508k$14plg$1@dont-email.me>
<v1at23$2ksi4$2@dont-email.me>
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
Injection-Date: Mon, 06 May 2024 21:34:51 +0200 (CEST)
Injection-Info: dont-email.me; posting-host="8396ebddaf6fc772f33ceafabe7b724f";
logging-data="2893842"; mail-complaints-to="abuse@eternal-september.org"; posting-account="U2FsdGVkX1/R/hdTfXzvcdgGiTKwGrtEEuL9amg+tAM="
User-Agent: Mozilla Thunderbird
Cancel-Lock: sha1:Ur80ZdM9qMDDcWguk/ouXnm5H04=
In-Reply-To: <v1at23$2ksi4$2@dont-email.me>
Content-Language: en-GB
View all headers

On 06/05/2024 16:30, candycanearter07 wrote:
> The Natural Philosopher <tnp@invalid.invalid> wrote at 09:48 this Saturday (GMT):
>> On 04/05/2024 01:13, Computer Nerd Kev wrote:
>>> I wouldn't know what to do with 8GB (well I know some people like
>>> to run lots of VMs, but that's too much to think about in my
>>> opinion).
>>
>> Once you run a GUI and some modern python style code its amazing how
>> much ram crap apps can gobble up
>>
>> I just upgraded from 8GB because the combination of 3GB of windows VM
>> plus a browser running a 3D printers webserver with embedded video, plus
>> a Python 3D slicer overwhelmed the machine and sent it into swap.
>>
>> Firefox seems to spawn an infinite number of 'webkit' and 'isolated web
>> company' children
>>
>> Especially with necessary ad blockers installed
>>
>> Thunderbird is over half a GB
>>
>> Orca slicer is 400GB+
>>
>> Plus two instances of a linux game I am playing takes *hard* usage to
>> over 8GB/ I.e before cached files etc.
>>
>> Now these are all things I want to do *at the same time*. Edit in
>> windows VM, pass 3D files to the slicer, monitor print progress via the
>> web interface, and play a linux game to while away the minutes waiting
>> for the 3D printer to turn out yet another 'close, but no cigar' print
>> that needs re-editing. Or while reading the news^H^H^H^H propaganda, or
>> Usenet, or getting email in.
>>
>> All I can say is, thank Clapton Linux has a really good memory manager.
>>
>>
>> $ free -m
>> total used free shared buff/cache
>> available
>> Mem: 23909 7385 931 1044 15592
>> 15090
>> Swap: 2047 0 2047
>>
>> I can't control 3rd party apps, but I can control my machine's memory.
>>
>> Up till buying a 3D printer 8GB was more than enough, but the constant
>> use of windows based 3D and 2D CAD programs plus the slicer and
>> firefoxes latest bloatery has taken it over the edge
>
>
> Yeah, but what other JS-compatible browsers exist? Chromium is also bad
> with memory..

They are all like that, as the manager said..

https://www.youtube.com/watch?v=k58knuvcQjQ

--
A lie can travel halfway around the world while the truth is putting on
its shoes.

Subject: Re: Linux doesn't seem to manage memory very well
From: 26xh.0717
Newsgroups: comp.os.linux.misc
Organization: snippy grate
Date: Sat, 1 Jun 2024 04:30 UTC
References: 1 2
Path: eternal-september.org!news.eternal-september.org!feeder3.eternal-september.org!border-1.nntp.ord.giganews.com!border-4.nntp.ord.giganews.com!nntp.giganews.com!Xl.tags.giganews.com!local-1.nntp.ord.giganews.com!nntp.earthlink.com!news.earthlink.com.POSTED!not-for-mail
NNTP-Posting-Date: Sat, 01 Jun 2024 04:30:53 +0000
Subject: Re: Linux doesn't seem to manage memory very well
Newsgroups: comp.os.linux.misc
References: <v0t5nk$3415a$1@dont-email.me>
<e87fab9e-57a1-7a46-2e34-dd73508bec5c@example.net>
From: 26xh.0718@e6t4y.net (26xh.0717)
Organization: snippy grate
Date: Sat, 1 Jun 2024 00:30:52 -0400
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101
Thunderbird/78.13.0
MIME-Version: 1.0
In-Reply-To: <e87fab9e-57a1-7a46-2e34-dd73508bec5c@example.net>
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 7bit
Message-ID: <YDSdndm-dcJgPsf7nZ2dnZfqn_ednZ2d@earthlink.com>
Lines: 33
X-Usenet-Provider: http://www.giganews.com
NNTP-Posting-Host: 99.101.150.97
X-Trace: sv3-MRV9IpsDuhXiFjcwFZmTZdyvMbpS/U2yPNrWqJ8JA3DRVJdoBnFCAe6BMcYU41Wo3hOEXTyKeFWytLq!S188ohaTj3hG5nsAE9TpJkM5ksxdsj5JIi6vYmkZgVYlXuXsN1DeYdWJW21XLlhTshEgfMVS2W8j!NcRC6IkL1x0kZJglihD5
X-Abuse-and-DMCA-Info: Please be sure to forward a copy of ALL headers
X-Abuse-and-DMCA-Info: Otherwise we will be unable to process your complaint properly
X-Postfilter: 1.3.40
View all headers

On 5/1/24 3:05 PM, D wrote:
>
>
> On Wed, 1 May 2024, James Harris wrote:
>
>> Not a question, just an observation.
>>
>> I say that Linux doesn't seem to handle memory well because my laptop
>> had 8GB RAM (which, frankly, Windows seems to find perfectly adequate
>> for a similar workload). Under Linux the RAM would fill up and then
>> swap space would be used. Then the machine would become largely
>> unresponsive - e.g. taking minutes to switch between windows.
>>
>> So I upgraded the RAM. It now has three times as much (i.e. 24GB)! But
>> even so, RAM has still steadily filled up until reaching the full
>> 24GB. What's more, it's now showing 4.8GB of swap space in use.
>
> Sounds like some rouge application and not linux. I never had any ram
> problems with linux given 4, 8 and now 16 gb of ram and I run firefox
> and xfce. Even ran gnome on 4 gb ram and no problems.

Agreed ... Linux manages memory perfectly OK. His
prob is a rogue app, likely failing to de-allocate
some kind of (largish) buffers. He may need to
run valgrind, or at least sudo pmap -x <pid>
several times on suspected apps to see what's
going on. ps can kind-of be coerced into showing
the real usage, but it's a lot of flags. top can
also give you a fair picture.

Dynamic memory allocation - albeit ancient - can
be a pain.

Pages:123

rocksolid light 0.9.8
clearnet tor