You almost certainly have a bogus function called exp in your search path somewhere, which calls itself. It may be in your workspace (global environment), or (less likely but possible) in a package you have loaded. (It's also possible that the infinite recursion is defined in a more complicated way, i.e. rather than exp() calling itself, it calls something that calls it back ...)
The normal, expected result of find("exp") is
[1] "package:base"
Suppose you have defined a recursive exp function in your workspace:
exp <- function(x) exp(x)
Then exp(1) will give
Error: C stack usage 7969716 is too close to the limit
and find("exp") will give
[1] ".GlobalEnv" "package:base"
i.e. there is an exp in the global environment that R will see before it sees the built-in function in the base package.
If you do have something like this going on, starting a new R session will help (unless the object is in a saved workspace that gets restored when the session starts), or rm("exp").