Asked about Generators and working with large data
How would you process a file larger than your available RAM?
An answer that works
Loop over the file object rather than calling read or readlines, so it yields one line at a time. Wrap it in a generator if you need to transform the records, and batch it if the next step wants groups.
Reading an answer is not being able to give one. The section that teaches this is Generators and working with large data, 3 hours of Python.
Learn this properlyAlso asked about Python
What is the difference between a list and a tuple?Why use join instead of adding strings in a loop?What is the difference between == and is?What does s[::-1] do?How would you remove duplicates from a list?Why is checking membership in a set faster than in a list?What happens if you use a list as a dictionary key?What is the difference between sorted(x) and x.sort()?
All 36 questions on Python