The biggest concern with gravel (outside of falling down), is getting a rock on the belt.
If you are riding alone, just keep it slow so you don't spit a rock off the front tire up to the belt.
If you are riding with others, either go first or stay back a good bit so the rocks stop bouncing before they get to you.
Personally, I ride gravel when it gets between me and where I want to explore. (Does this road go through?)
The Savage handles OK in gravel, but it ain't a dirt bike and doesn't have the tires to grip that kind of surface very well. You see a corner coming, you better slow down.. A LOT.
I would have freaked if a squirrel jumped up in front of me on the bike!