New cache implementation and prefetch handing in mw/cache (#731)

* cache: add sharded cache implementation

Add Cache impl and a few tests. This cache is 256-way sharded, mainly
so each shard has it's own lock. The main cache structure is a readonly
jump plane into the right shard.

This should remove the single lock contention on the main lock and
provide more concurrent throughput - Obviously this hasn't been tested
or measured.

The key into the cache was made a uint32 (hash.fnv) and the hashing op
is not using strings.ToLower anymore remove any GC in that code path.

* here too

* Minimum shard size

* typos

* blurp

* small cleanups no defer

* typo

* Add freq based on Johns idea

* cherry-pick conflict resolv

* typo

* update from early code review from john

* add prefetch to the cache

* mw/cache: add prefetch

* remove println

* remove comment

* Fix tests

* Test prefetch in setup

* Add start of cache

* try add diff cache options

* Add hacky testcase

* not needed

* allow the use of a percentage for prefetch

If the TTL falls below xx% do a prefetch, if the record was popular.
Some other fixes and correctly prefetch only popular records.

1 files changed, 0 insertions, 20 deletions

diff --git a/middleware/cache/item_test.go b/middleware/cache/item_test.go
deleted file mode 100644
index b338d02bd..000000000
--- a/middleware/cache/item_test.go
+++ /dev/null
@@ -1,20 +0,0 @@
-package cache
-
-import (
-	"testing"
-
-	"github.com/miekg/dns"
-)
-
-func TestKey(t *testing.T) {
-	if x := rawKey("miek.nl.", dns.TypeMX, false); x != "0miek.nl..15" {
-		t.Errorf("failed to create correct key, got %s", x)
-	}
-	if x := rawKey("miek.nl.", dns.TypeMX, true); x != "1miek.nl..15" {
-		t.Errorf("failed to create correct key, got %s", x)
-	}
-	// rawKey does not lowercase.
-	if x := rawKey("miEK.nL.", dns.TypeMX, true); x != "1miEK.nL..15" {
-		t.Errorf("failed to create correct key, got %s", x)
-	}
-}