Want to be notified when a new article is posted? Entere your email here.

Saturday, July 15, 2006

Where Do You Get Data For Research?

After my recent post on academic research, one of my readers asked
"Where do you get the data for most of your studies? Do you use the same sources most of the time, or is it different depending on the study?"
That's are a couple of great questions. The answer to your second question is "Yes". There's a lot of variety in the types of data that finance researchers use in their studies. Not surprisingly, the data used depends on the research questions you're trying to answer. For example, if you work in a narrowly defined area, your research projects could easily end up using the same data again and again.

Some studies use commonly available data sources, some use hand-collected data, and some use both. There are quite a few "standard" data sets that accounting and finance academic researchers use on a regular basis (while the two fields are different in many ways, there's a lot of overlap between finance and financial accounting). Some of the most common data sets include:
  • The Center For Research In Securities Prices (a.k.a. "CRSP") data compiled by the University of Chicago, which has daily price, distribution, volume, and return data for over 5,000 publicly traded stocks back to the 60s;
  • Standard and Poor's COMPUSTAT database of annual and quarterly financial statement data;
  • Thomson Financial's Institutional Brokers Estimates (IBES) database of historical individual and consensus analyst forecasts.
  • Thomson's other databases covering merger and acquisition and securities issue transactions, insider trades, institutional holdings, and bankruptcies;
  • The TAQ (NYSE Trade and Quoting Database) of intraday stock transaction (i.e. trade and quotation) data ;
There are also quite a few others. I've used (or am currently using ) all of the above except the TAQ data in one project of another (the TAQ data is used mostly by in market microstructure research, and I'm a corporate finance guy).

The advantage to data sources that are on computer-readable media is that they can be "sliced and diced" in multiple ways if you're a good enough programmer. This makes it possible to do large scale studies of things like which factors determine the market reactions to insider trades or whether cap-weighted or fundamental-weighted indexes provide better risk-adjusted returns. Some studies, in fact, use only computer-ready data. Not surprisingly, the people who do these kinds of studies are usually either pretty good programmers themselves (usually in SAS, C, or some other package or language), or have graduate students that can grind the data for them.

But like anything else, this (relative) ease of access makes it harder to find truly interesting new ideas that merely use these data sources. So, many other studies also use hand-collected data (this is particularly true in corporate finance research). The hand collection of data can be a long and tedious process , but it has some real advantages.

For example, I am working with a graduate student on the relationship between corporate governance and the success of a certain type of corporate decision. Before we can do any analysis, he first has to gather and code (yes, I'm management, and he's operations) board, ownership, and compensation data on about 500-600 transactions. This will involve him spending about 150-200 hours reading through corporate proxy statements to determine firms' board composition, ownership structure, and compensation structures (that's where this data is typically found).

Once we have the governance data, we can get the analyst, financial statement, and stock market data from the above mentioned databases through programming.

Gathering this type of data is a long and tedious process. But that also has its advantages. This cost of data acquisition serves makes for a significant barrier to entry, which makes it difficult for anyone else to easily replicate our idea. So, if we play our cards right, we could conceivably get 2-3 (or even more) papers out of the data set before anyone else gets something similar. In fact, the data will also form the basis for his dissertation, and he will probably end up expanding it (and using it to examine other issues) for the next couple of years.

23 comments:

Anonymous said...

I don't even know how I ended up here, but I thought this post was great. I don't know who you are but definitely you're going to a famous blogger if you aren't already ;) Cheers!


my blog ... local directory business

Anonymous said...

These are truly great ideas in regarding blogging.
You have touched some pleasant points here. Any way keep up wrinting.


My web blog: nutrition research paper topics

Anonymous said...

Remarkable! Its truly remarkable post, I have got much clear idea regarding
from this piece of writing.

My weblog - business pages online

Anonymous said...

First of all I want to say superb blog! I had a quick question in which I'd like to ask if you don't mind.

I was interested to find out how you center yourself and clear
your thoughts prior to writing. I've had trouble clearing my mind in getting my thoughts out there. I truly do take pleasure in writing but it just seems like the first 10 to 15 minutes are generally wasted just trying to figure out how to begin. Any recommendations or tips? Thank you!

my blog ... george orwell essays

Anonymous said...

When I originally commented I clicked the "Notify me when new comments are added" checkbox and now each time a comment
is added I get four e-mails with the same comment.
Is there any way you can remove people from that
service? Appreciate it!

Here is my homepage; business white pages

Anonymous said...

Greetings! This is my 1st comment here so I just wanted to give a quick shout out and tell you I genuinely enjoy reading your blog posts.
Can you recommend any other blogs/websites/forums that
go over the same topics? Thanks a lot!

Here is my page; bags bunny t-shirts for women

Anonymous said...

Thank you for every other informative site. Where else may just
I am getting that kind of info written in such a perfect means?
I have a mission that I am simply now working on, and I've been at the glance out for such information.

Look at my homepage - writing a college research paper

Anonymous said...

Hey there! This is my 1st comment here so I just wanted to give
a quick shout out and tell you I genuinely enjoy reading through your
blog posts. Can you suggest any other blogs/websites/forums that go over the same
topics? Appreciate it!

my website: cartoon t-shirts stores

Anonymous said...

Hey there I am so grateful I found your webpage, I really found you
by error, while I was searching on Aol for something else, Regardless I am here now
and would just like to say thanks for a
marvelous post and a all round exciting blog (I also love the theme/design),
I don’t have time to read through it all at the moment
but I have book-marked it and also added in your RSS feeds,
so when I have time I will be back to read a lot more, Please do keep
up the excellent b.

Also visit my web page :: custom research writing

Anonymous said...

Very good blog! Do you have any helpful hints for aspiring writers?
I'm planning to start my own website soon but I'm a little lost on everything.
Would you suggest starting with a free platform like Wordpress or go for a paid option?

There are so many choices out there that I'm totally confused .. Any suggestions? Kudos!

my homepage: essay writing samples

Anonymous said...

Very nice post. I just stumbled upon your blog and wished to say that I've truly enjoyed surfing around your blog posts. In any case I will be subscribing to your feed and I hope you write again soon!

Look at my site :: movie forumz tv tags

Anonymous said...

What's Going down i'm new to this, I stumbled
upon this I've discovered It positively useful and it has aided me out loads. I am hoping to give a contribution & aid other users like its aided me. Good job.

Here is my web-site; free essay grader

Anonymous said...

My brother suggested I may like this website. He used to be
entirely right. This put up actually made my
day. You can not imagine simply how so much time I had spent
for this info! Thank you!

Take a look at my blog post - definition essay topics

Anonymous said...

Hi there, after reading this amazing piece of writing i am too happy to share my knowledge here with mates.


Here is my webpage sell broken computers charlotte nc

Anonymous said...

Pretty section of content. I just stumbled upon your web site and in
accession capital to claim that I acquire actually
loved account your blog posts. Any way I will be subscribing in your augment or even I fulfillment
you get admission to persistently quickly.


my blog post - business listing list site

Anonymous said...

Hi there, after reading this remarkable piece of writing i am too
happy to share my experience here with colleagues.

My website - film chas pik 3

Anonymous said...

Your style is really unique compared to other folks I've read stuff from. Many thanks for posting when you have the opportunity, Guess I will just bookmark this blog.

My weblog ... descriptive essay example

Anonymous said...

Very good site you have here but I was wondering if you knew of any discussion boards that cover the same topics discussed
in this article? I'd really like to be a part of online community where I can get suggestions from other knowledgeable individuals that share the same interest. If you have any recommendations, please let me know. Kudos!

Feel free to visit my web blog - example of research paper

Anonymous said...

Stunning story there. What occurred after? Good
luck!

Here is my web page local business directory usa

Anonymous said...

I know this if off topic but I'm looking into starting my own weblog and was curious what all is required to get set up? I'm
assuming having a blog like yours would cost a pretty penny?
I'm not very web savvy so I'm not 100% certain. Any recommendations or advice
would be greatly appreciated. Many thanks

my webpage ... local real estate

Anonymous said...

Hi there friends, how is everything, and what you want to say about this
paragraph, in my view its in fact remarkable designed for me.


My web site :: forums film noir buff

Anonymous said...

I am actually thankful to the holder of this site who has shared this great paragraph at here.


my blog post - psychology term paper topics

Anonymous said...

An impressive share! I have just forwarded this onto a co-worker who has
been doing a little homework on this. And he actually
ordered me lunch because I found it for him... lol. So let
me reword this.... Thanks for the meal!! But yeah, thanx for spending time to discuss
this subject here on your website.

Here is my blog post :: local businesss ()