• Yang Shi's avatar
    arm64: bpf: make BPF prologue and epilogue align with ARM64 AAPCS · ec0738db
    Yang Shi authored
    Save and restore FP/LR in BPF prog prologue and epilogue, save SP to FP
    in prologue in order to get the correct stack backtrace.
    
    However, ARM64 JIT used FP (x29) as eBPF fp register, FP is subjected to
    change during function call so it may cause the BPF prog stack base address
    change too.
    
    Use x25 to replace FP as BPF stack base register (fp). Since x25 is callee
    saved register, so it will keep intact during function call.
    It is initialized in BPF prog prologue when BPF prog is started to run
    everytime. Save and restore x25/x26 in BPF prologue and epilogue to keep
    them intact for the outside of BPF. Actually, x26 is unnecessary, but SP
    requires 16 bytes alignment.
    
    So, the BPF stack layout looks like:
    
                                     high
             original A64_SP =>   0:+-----+ BPF prologue
                                    |FP/LR|
             current A64_FP =>  -16:+-----+
                                    | ... | callee saved registers
                                    +-----+
                                    |     | x25/x26
             BPF fp register => -80:+-----+
                                    |     |
                                    | ... | BPF prog stack
                                    |     |
                                    |     |
             current A64_SP =>      +-----+
                                    |     |
                                    | ... | Function call stack
                                    |     |
                                    +-----+
                                      low
    
    CC: Zi Shen Lim <zlim.lnx@gmail.com>
    CC: Xi Wang <xi.wang@gmail.com>
    Signed-off-by: default avatarYang Shi <yang.shi@linaro.org>
    Acked-by: default avatarZi Shen Lim <zlim.lnx@gmail.com>
    Signed-off-by: default avatarDavid S. Miller <davem@davemloft.net>
    ec0738db
bpf_jit_comp.c 20 KB