Memory management is a complex field of computer science and there
are many techniques being developed to make it more efficient.
This guide is designed to introduce you to some of the basic memory
management issues that programmers face.
Some platforms have specific problems in dealing with memory, which are not covered in depth here. In particular, if you are looking for information on configuring memory under DOS or Windows (EMS, XMS,
This guide attempts to explain any terms it uses as it introduces them. In addition, there is a Glossary of memory management terms that gives fuller information; some terms are linked to the relevant entries.
Memory management is usually divided into three areas: hardware, operating system, and application (described in more detail below), although the distinctions are a little fuzzy. In most computer systems, all three are present to some extent, forming layers between the user's program and the actual memory hardware. The Memory Management Reference is mostly concerned with application memory management.
Typical problems include:
The advantages of manual memory management are:
The following languages use mainly manual memory management in most implementations, although many have conservative garbage collection extensions: Algol; C; C++; COBOL; Fortran; Pascal.
For more information, see manual memory management in the Glossary.
The advantages of automatic memory management are:
Some platforms have specific problems in dealing with memory, which are not covered in depth here. In particular, if you are looking for information on configuring memory under DOS or Windows (EMS, XMS,
HIMEM.SYS
, and the like), then you won't find The Memory Management Reference very useful.This guide attempts to explain any terms it uses as it introduces them. In addition, there is a Glossary of memory management terms that gives fuller information; some terms are linked to the relevant entries.
Memory management is usually divided into three areas: hardware, operating system, and application (described in more detail below), although the distinctions are a little fuzzy. In most computer systems, all three are present to some extent, forming layers between the user's program and the actual memory hardware. The Memory Management Reference is mostly concerned with application memory management.
- Hardware memory management
- Memory management at the hardware level is concerned with the electronic devices that actually store data. This includes things like RAM and memory caches.
- Operating system memory management
- In the operating system, memory must be allocated to user programs, and reused by other programs when it is no longer required. The operating system can pretend that the computer has more memory than it actually does, and also that each program has the machine's memory to itself; both of these are features of virtual memory systems.
- Application memory management
- Application memory management involves supplying the memory
needed for a program's objects and data structures from the limited
resources available, and recycling that memory for reuse when it is no
longer required.
Because application programs cannot in general predict in advance how
much memory they are going to require, they need additional code to
handle their changing memory requirements.
Application memory management combines two related tasks:
- Allocation
- When the program requests a block of memory, the memory manager must allocate that block out of the larger blocks it has received from the operating system. The part of the memory manager that does this is known as the allocator. There are many ways to perform allocation, a few of which are discussed in Allocation techniques.
- Recycling
- When memory blocks have been allocated, but the data they contain is no longer required by the program, then the blocks can be recycled for reuse. There are two approaches to recycling memory: either the programmer must decide when memory can be reused (known as manual memory management); or the memory manager must be able to work it out (known as automatic memory management). These are both described in more detail below.
- CPU overhead
- The additional time taken by the memory manager while the program is running;
- Interactive pause times
- How much delay an interactive user observes;
- Memory overhead
- How much space is wasted for administration, rounding (known as internal fragmentation), and poor layout (known as external fragmentation).
Memory management problems
The basic problem in managing memory is knowing when to keep the data it contains, and when to throw it away so that the memory can be reused. This sounds easy, but is, in fact, such a hard problem that it is an entire field of study in its own right. In an ideal world, most programmers wouldn't have to worry about memory management issues. Unfortunately, there are many ways in which poor memory management practice can affect the robustness and speed of programs, both in manual and in automatic memory management.Typical problems include:
- Premature free or dangling pointer
- Many programs give up memory, but attempt to access it later and crash or behave randomly. This condition is known as premature free, and the surviving reference to the memory is known as a dangling pointer. This is usually confined to manual memory management.
- Memory leak
- Some programs continually allocate memory without ever giving it up and eventually run out of memory. This condition is known as a memory leak.
- External fragmentation
- A poor allocator can do its job of giving out and receiving blocks of memory so badly that it can no longer give out big enough blocks despite having enough spare memory. This is because the free memory can become split into many small blocks, separated by blocks still in use. This condition is known as external fragmentation.
- Poor locality of reference
- Another problem with the layout of allocated blocks comes from the way that modern hardware and operating system memory managers handle memory: successive memory accesses are faster if they are to nearby memory locations. If the memory manager places far apart the blocks a program will use together, then this will cause performance problems. This condition is known as poor locality of reference.
- Inflexible design
- Memory managers can also cause severe performance problems if they have been designed with one use in mind, but are used in a different way. These problems occur because any memory management solution tends to make assumptions about the way in which the program is going to use memory, such as typical block sizes, reference patterns, or lifetimes of objects. If these assumptions are wrong, then the memory manager may spend a lot more time doing bookkeeping work to keep up with what's happening.
- Interface complexity
- If objects are passed between modules, then the interface design must consider the management of their memory.
Manual memory management
Manual memory management is where the programmer has direct control over when memory may be recycled. Usually this is either by explicit calls to heap management functions (for example,malloc
/free
in C), or by language constructs that affect the stack
(such as local variables). The key feature of a manual memory manager
is that it provides a way for the program to say, "Have this memory
back; I've finished with it"; the memory manager does not recycle any
memory without such an instruction.The advantages of manual memory management are:
- It can be easier for the programmer to understand exactly what is going on;
- Some manual memory managers perform better when there is a shortage of memory.
- The programmer must write a lot of code to do repetitive bookkeeping of memory;
- Memory management must form a significant part of any module interface;
- Manual memory management typically requires more memory overhead per object;
- Memory management bugs are common.
The following languages use mainly manual memory management in most implementations, although many have conservative garbage collection extensions: Algol; C; C++; COBOL; Fortran; Pascal.
For more information, see manual memory management in the Glossary.
Automatic memory management
Automatic memory management is a service, either as a part of the language or as an extension, that automatically recycles memory that a program would not otherwise use again. Automatic memory managers (often known as garbage collectors, or simply collectors) usually do their job by recycling blocks that are unreachable from the program variables (that is, blocks that cannot be reached by following pointers).The advantages of automatic memory management are:
- The programmer is freed to work on the actual problem;
- Module interfaces are cleaner;
- There are fewer memory management bugs;
- Memory management is often more efficient.
- Memory may be retained because it is reachable, but won't be used again;
- Automatic memory managers (currently) have limited availability.
No comments:
Post a Comment
its cool