Carry on straight from here. The road ahead turns left at a railway, but cross those and continue up a cobbled stone path. Turn right at the top of that path.
From here it is straight, and uphill, all the way into Oliveira.
