Commit d5aec7ba authored by Antoine Pitrou's avatar Antoine Pitrou

Issue #21116: Avoid blowing memory when allocating a multiprocessing shared

array that's larger than 50% of the available RAM.

Patch by Médéric Boquien.
parent 4269d6db
......@@ -71,7 +71,14 @@ else:
os.unlink(name)
util.Finalize(self, os.close, (self.fd,))
with open(self.fd, 'wb', closefd=False) as f:
f.write(b'\0'*size)
bs = 1024 * 1024
if size >= bs:
zeros = b'\0' * bs
for _ in range(size // bs):
f.write(zeros)
del zeros
f.write(b'\0' * (size % bs))
assert f.tell() == size
self.buffer = mmap.mmap(self.fd, self.size)
def reduce_arena(a):
......
......@@ -154,6 +154,7 @@ Wouter Bolsterlee
Gawain Bolton
Forest Bond
Gregory Bond
Médéric Boquien
Matias Bordese
Jonas Borgström
Jurjen Bos
......
......@@ -29,6 +29,9 @@ Core and Builtins
Library
-------
- Issue #21116: Avoid blowing memory when allocating a multiprocessing shared
array that's larger than 50% of the available RAM. Patch by Médéric Boquien.
- Issue #22982: Improve BOM handling when seeking to multiple positions of
a writable text file.
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment