Thanks rfeecs, you pushed me into the right direction and I finally got it!
One of my problems was, that I neglected the phase of the reflection coefficient in my calculations, but (1+|r|) not= (1+r).
So with that error ruled out I could calculate the Voltage at Node A. Here is how I did it. Maybe it helps someone:
V
A=V
P*(1+r) = 0.447 exp(-j26°) with V
P=0.5V and r=0.447 exp(-j116°) (r can either be calculated from the values with ((R
1||Z
X) - Z
0)/((R
1||Z
X) + Z
0) with Z
X being the impedance when looking into the stub. Or simply read it from a Smith Chart)
With V
A the voltage at Node B can be calculated with V
A=V_B * cosh(gamma *L) + I
B*Z
L*sinh(gamma L). Because the stub is open I
B=0.
So V
B=V
A/cosh(gamma L).
With a lossless line gamma=j*beta and hence
V
B=V
A/cos(beta L).
In my example L=lambda/8 and so: V
B=V
A*sqrt(2) = 0.633V exp(-j26°)