Puppet: System Administration Automated

Support

Ticket #451 (closed defect: wontfix)

Opened 2 years ago

Last modified 2 years ago

Large files are slow to transfer over the puppet: protocol

Reported by: ianburrell Assigned to: luke
Priority: normal Milestone:
Component: file Version: 0.22.0
Severity: normal Keywords:
Cc: Triage Stage: Unreviewed
Attached Patches: None Complexity: Unknown

Description

The puppetmasterd uses lots of CPU and RAM when transferring large files from a puppet server. I have a 26 MB file which copied in about 250 sec. Even worse than the time is that the puppetmasterd used 99% of the CPU and grew to 78% of the 1 GB RAM. The process did shrink after finishing but it is worrying that it can that much CPU and RAM.

The first time, the client died with the error from bug 143.

Change History

01/24/07 14:50:18 changed by jcollie

From what I can tell (I don't know Ruby very well), the fileserver is reading the entire file into memory and CGI escaping the string before sending it to the client. Obviously, if you are reading a large file that will consume a large amount of memory and CPU. Until the protocol is redesigned to be more memory and CPU efficent I'd suggest serving up files (especially the large ones) using a standard HTTP server.

04/05/07 22:37:48 changed by luke

  • status changed from new to closed.
  • specification set to Unnecessary.
  • patch set to None.
  • complexity set to Unknown.
  • approval set to Unnecessary.
  • resolution set to wontfix.
  • compatibility set to Unknown.
  • stage set to Unreviewed.

I'm closing this in favor of #583. Fixing it will (mostly) fix this.