After switching to an SSD it has significantly reduced those lag events. It is pretty much smooth all the time now, thanks for that suggestion whoever said it.
So I was watching the performance moniter while playing and it looks like the lag spikes (which only happen while exploring) coincide with large disk usage spikes. I'm going to try the SSD fix, but it seems like there must be a better way. I have 24…