John Sansom - SQL Server DBA in the UK » Memory http://www.johnsansom.com SQL Server DBA Blog, with straightforward advice, quality resources and musings about SQL Server Fri, 03 Sep 2010 13:39:00 +0000 en hourly 1 http://wordpress.org/?v=3.0.1 The SQL Server Buffer Pool and Buffer Cache Hit Ratio http://www.johnsansom.com/index.php/2009/03/the-sql-server-buffer-pool-and-buffer-cache-hit-ratio/ http://www.johnsansom.com/index.php/2009/03/the-sql-server-buffer-pool-and-buffer-cache-hit-ratio/#comments Tue, 31 Mar 2009 12:36:06 +0000 John Sansom http://www.johnsansom.com/?p=373 There seems to be some confusion surrounding Buffer Cache Hit Ratio and the SQL Server Buffer Cache. Having answered several queries concerning this over the last few weeks on a variety of forums I thought I would post here in order set the record straight.

What is the SQL Server Buffer Cache?

The Buffer Cache is an area of the SQL Server Buffer Pool (which in turn is part of the overall SQL Server Process space) and in simple terms is the amount of your database data (data pages) that is stored in memory.

What is Buffer Cache Hit Ratio?

The performance measure buffer cache hit ratio expresses as a percentage, how often a request for a database data page, can be served from the Buffer Pool. The alternative action is for SQL Server to have to fetch the data page from disk.

So for example, if you have a 500MB database, a server with 4GB and SQL Server is configured to use all available memory, you will have a very good Buffer Cache Hit ratio of 99% or above because your entire database can easily fit into memory.

How can I determine the Buffer Cache Hit Ratio of my server?

In order to determine you buffer cache hit ratio you can use the Windows Performance Monitor.

1. Just go to Start > Programs > Administrative Tools > Performance 2. Right click the graph and choose Add Counters. 3. Select Performance object, SQLServer:Buffer Manager 4. Add, Buffer Cache Hit Ratio.

Buffer Cache Hit Ratio

Windows Performanc Monitor - Biffer Cache Hot Ratio

How can I get more detailed information about SQL Servers memory usage?

In order to get a detailed report of SQL Servers memory usage I like to use the DBCC statement:

DBCC MEMORYSTATUS

Useful SQL Server Memory References

SQLOS’s memory manager and SQL Server’s Buffer Pool

Memory Configuration – AWE, PAE the /3GB Swith, MAX and MIN settings

SQL Server Memory Configuration, Determining MemToLeave Settings

Can’t Find the Answer You Are Looking For?

If you have a query about SQL Server that you can’t find the answer for then please do feel free to ask me.

]]> http://www.johnsansom.com/index.php/2009/03/the-sql-server-buffer-pool-and-buffer-cache-hit-ratio/feed/ 0 SQL Server Memory Configuration, Determining MemToLeave Settings http://www.johnsansom.com/index.php/2009/03/sql-server-memory-configuration-determining-memtoleave-settings/ http://www.johnsansom.com/index.php/2009/03/sql-server-memory-configuration-determining-memtoleave-settings/#comments Mon, 16 Mar 2009 15:52:47 +0000 John Sansom http://johnsansom.com/?p=117 Determining the appropriate memory configuration for a SQL Server platform is a task that all database administrators are required to perform. It is essential to ensuring that an appropriate level of performance can be provided.

I am going to discuss some of the additional memory configuration tweaking that you may wish to undertake so that your environment can provide adequate support for workloads involving managed code, .NET CLR, Linked Servers and extended stored procedures.

Establishing a good foundation

Before considering additional tweaking of your SQL Server platform, it is wise to have already established a good foundation and to have addressed the basics.

To begin with you will want to ensure that the correct settings for both the hardware and software (Windows operating system version and SQL Server Edition) for your particular environment have been applied. You will no doubt also wish to ensure that your choice of configuration makes the maximum possible use of the resource available to you.

There are a number of excellent resources and references regarding how to configure SQL Server that can be found in the SQL Server Administration area.

Additional considerations when configuring SQL server memory

Having established a good foundation, in addition to this you may find that the specific requirements of your individual platform require you to carry out further tweaking.

For example, your environment may dictate that SQL Server share the available server memory with other applications, in which case you will need to consider the distribution of memory resource between these. The ideal configuration choice is that SQL Server runs on its own dedicated server however this may not always be practical.

Now suppose your environment uses a fair amount of managed code such as .NET CLR. These technologies naturally require memory just as SQL Server does however one critical point to note is that the memory for these resources is allocated from outside of the SQL Server Buffer, in a portion of memory known as MemToLeave.

What is MemToLeave?

MemToLeave is virtual address space (VAS) that’s left un-used when SQL Server starts so that external components called by SQL Server are saved some address space. So in order for these technologies, .NET CLR, Linked Servers and extended stored procedures, to operate efficiently you must ensure that they too have access to sufficient memory.

This is why it is often recommended that you explicitly set the maximum amount of memory that SQL Server uses, as opposed to allowing it to consume all that is available on your server.

How do I determine my MemToLeave usage?

To assist in assessing your current utilisation, the T-SQL script below can be used to identify the largest available block of virtual address space (MemToLeave) outside of the buffer pool and is sourced from Christian Bolton’s Blog Post – SQL Server memtoleave, VAS and 64-bit

The query utilises the Dynamic Management View (DMV) sys.dm_os_virtual_address_dump which returns information about pages in the virtual address space of the calling process.

WITH VAS_Summary
AS (
    SELECT
    Size = VAS_Dump.Size,
    Reserved =
        SUM(CASE(CONVERT(INT, VAS_Dump.Base) ^ 0)
            WHEN 0 THEN 0
            ELSE 1
            END),
    Free =
        SUM(CASE(CONVERT(INT, VAS_Dump.Base) ^ 0)
            WHEN 0 THEN 1
            ELSE 0
            END)
    FROM
    (
        SELECT
            CONVERT(VARBINARY, SUM(region_size_in_bytes)) [Size],
            region_allocation_base_address [Base]
        FROM sys.dm_os_virtual_address_dump
        WHERE region_allocation_base_address <> 0
        GROUP BY region_allocation_base_address
        UNION
        SELECT
            CONVERT(VARBINARY, region_size_in_bytes) [Size],
            region_allocation_base_address [Base]
        FROM   sys.dm_os_virtual_address_dump
        WHERE  region_allocation_base_address = 0x0
        ) AS VAS_Dump
    GROUP BY Size
    )
SELECT
    SUM(CONVERT(BIGINT, Size) * Free) / 1024 AS [Total avail mem, KB],
    CAST(MAX(Size) AS BIGINT) / 1024 AS [Max free size, KB]
FROM VAS_Summary
WHERE Free <> 0

How can I tell if I need to allocate more memory to MemToLeave?

There are two key indicators that express a need to assign more memory to MemToLeave.

  1. If the above T-SQL script shows that the amount of available memory is small for the requirements of your platform. (For example, your application/development team may be able to advise on the expected memory requirements of the managed code components that have been developed).
  2. A more pressing indicator takes the form of a variety of warning/error messages raised by either SQL Server or the specific managed code component.

For example, if the MemToLeave region is too small for .NET managed code, a common indicator of this will be the appearance of frequent “Application Domain Unload” messages appearing in the SQL Server Error log. An example message is provided below:

AppDomain 8 (DatabaseName.dbo[runtime].7) is marked for unload due to common language runtime (CLR) or security data definition language (DDL) operations.

Another indicator is an error message that occurs when using Linked Server queries, that states:

“There is insufficient system memory to run this query.”

If you encounter any of these indicators then you almost certainly need to evaluate your SQL Server usage of VAS.

How do I allocate more resources to MemToLeave?

In the event that you determine that you require to increase the size of the MemToLeave area, this can be done by defining the -g startup option for the SQL Server Service.

The value that you assign to the parameter will determine the size of the MemToLeave area of memory.

If you are unsure of how much additional memory to allocate to MemToLeave, then it is best to increase the volume assigned in smaller increments for example 64MB (although dependent on your specific platform), until your original indicators are no longer being raised i.e. your application domain unload messages are no longer appearing.

Detailed instruction for using the -g startup option can be found in the books online article, Using the SQL Server Service Startup Options.

It is important to note that increasing the size of the MemToLeave area will reduce the amount of available memory to the SQL Server Buffer Pool. For this reason it is wise to iterate your tweaking of this parameter in small increments.

Summary

A SQL Server DBA is responsible for ensuring the performance of the platform/s they administer.

After completing an initial SQL Server configuration you may need to tweak your memory configuration further in order support managed code. Where appropriate, this can be achieved by using the SQL Server -g startup parameter.

I hope you have enjoyed reading this article and that it proves fruitful in your administration of SQL Server. If you have any questions about MemToLeave or anything whatsoever about SQL Server then please feel free to ask. You can add a comment using the form below, send me an email or contact me on Twitter @JohnSansom.

You may also find interesting…….

]]> http://www.johnsansom.com/index.php/2009/03/sql-server-memory-configuration-determining-memtoleave-settings/feed/ 4