The generalized Pareto distribution is used to model the exceedances over a threshold in a number of fields, including the analysis of environmental extreme events and financial data analysis. We use this model in a default Bayesian framework where no prior information is available on unknown model parameters. Using a large simulation study, we compare the performance of our posterior estimations of parameters with other methods proposed in the literature. We show that our procedure also allows to make inferences in other quantities of interest in extreme value analysis without asymptotic arguments. We apply the proposed methodology to a real data set.