SQL Server 2000 date and time puzzlerSun, Dec 4, 2005 in Databases
This article explains how comparing DATETIME and SMALLDATETIME values in SQL Server 2000 can introduce subtle bugs. I recently ran into a puzzling situation, which seemed like a bug in SQL Server 2000, but was in fact my fault. Even my sharpest colleagues were stumped. In fact, it turned out to be a fairly simple mistake.
The symptom was rows missing from a result. The problem was implicit data type casts.
declare @start smalldatetime, @end smalldatetime, @now datetime set @now = getdate() set @start = convert(char(10), @now, 126) set @end = dateadd(day, 1, @start) create table #offer ( ident int identity not null, startdate smalldatetime, enddate smalldatetime ) insert into #offer (startdate, enddate) values (null, null) insert into #offer (startdate, enddate) values (@start, null) insert into #offer (startdate, enddate) values (null, @end) insert into #offer (startdate, enddate) values (@start, @end)
The query and explanation
Here’s the query:
select * from #offer where @now between isnull(startdate, @now) and isnull(enddate, @now)
The table contains special offers, whose start/end date can be either specified or not (the offer is open-ended). I have inserted a row for each possible case of specified/open-ended. I wrote the select statement to select rows where the offer is valid, i.e. the current date is between the start and end dates. The problem was, only some rows were being selected. Run the code yourself and see. If you get all the rows, run the query again. This problem is non-deterministic – it depends on the current time, which makes it even worse.
This is actually correct behavior, and the reason has to do with the semantics of
ISNULL return type is the data type of its first argument – in this case, a
SMALLDATETIME. So when the column is
@now gets cast to
SMALLDATETIME, losing precision down to the minute.
To illustrate, let’s evaluate the query by hand, using one of the excluded rows, for example the one with both date columns
@now's value is
'2005-12-02 08:55:42.807', the
WHERE clause becomes
where '2005-12-02 08:55:42.807' between '2005-12-02 08:56:00' and '2005-12-02 08:56:00'
Obviously that clause is false, so the row won’t get included in the results.
The moral of the story is use matching data types. Implicit conversions can really bite you in the back.
COALESCE doesn’t cause this same behavior, because it converts all arguments to the same datatype, and the implicit conversion between
DATETIME is to greater precision, not less. That’s a subtle difference between
Something else is wrong with the query. The
ISNULL function will defeat the query optimizer’s ability to use any indexes that might exist on the date columns, causing a table scan. It is less human-readable, but better for the query optimizer, to write the
WHERE clause as a compound boolean statement:
... where (startdate is null or startdate <= @now) and (enddate is null or enddate >= @now)
I'm Baron Schwartz, the founder and CEO of VividCortex. I am the author of High Performance MySQL and many open-source tools for performance analysis, monitoring, and system administration. I contribute to various database communities such as Oracle, PostgreSQL, Redis and MongoDB.