• Mark Rutland's avatar
    arm64: entry: handle all vectors with C · ec841aab
    Mark Rutland authored
    We have 16 architectural exception vectors, and depending on kernel
    configuration we handle 8 or 12 of these with C code, with the remaining
    8 or 4 of these handled as special cases in the entry assembly.
    
    It would be nicer if the entry assembly were uniform for all exceptions,
    and we deferred any specific handling of the exceptions to C code. This
    way the entry assembly can be more easily templated without ifdeffery or
    special cases, and it's easier to modify the handling of these cases in
    future (e.g. to dump additional registers other context).
    
    This patch reworks the entry code so that we always have a C handler for
    every architectural exception vector, with the entry assembly being
    completely uniform. We now have to handle exceptions from EL1t and EL1h,
    and also have to handle exceptions from AArch32 even when the kernel is
    built without CONFIG_COMPAT. To make this clear and to simplify
    templating, we rename the top-level exception handlers with a consistent
    naming scheme:
    
      asm: <el+sp>_<regsize>_<type>
      c:   <el+sp>_<regsize>_<type>_handler
    
    .. where:
    
      <el+sp> is `el1t`, `el1h`, or `el0t`
      <regsize> is `64` or `32`
      <type> is `sync`, `irq`, `fiq`, or `error`
    
    ... e.g.
    
      asm: el1h_64_sync
      c:   el1h_64_sync_handler
    
    ... with lower-level handlers simply using "el1" and "compat" as today.
    
    For unexpected exceptions, this information is passed to
    __panic_unhandled(), so it can report the specific vector an unexpected
    exception was taken from, e.g.
    
    | Unhandled 64-bit el1t sync exception
    
    For vectors we never expect to enter legitimately, the C code is
    generated using a macro to avoid code duplication. The exceptions are
    handled via __panic_unhandled(), replacing bad_mode() (which is
    removed).
    
    The `kernel_ventry` and `entry_handler` assembly macros are updated to
    handle the new naming scheme. In theory it should be possible to
    generate the entry functions at the same time as the vectors using a
    single table, but this will require reworking the linker script to split
    the two into separate sections, so for now we have separate tables.
    Signed-off-by: default avatarMark Rutland <mark.rutland@arm.com>
    Acked-by: default avatarCatalin Marinas <catalin.marinas@arm.com>
    Acked-by: default avatarMarc Zyngier <maz@kernel.org>
    Reviewed-by: default avatarJoey Gouly <joey.gouly@arm.com>
    Cc: James Morse <james.morse@arm.com>
    Cc: Will Deacon <will@kernel.org>
    Link: https://lore.kernel.org/r/20210607094624.34689-15-mark.rutland@arm.comSigned-off-by: default avatarWill Deacon <will@kernel.org>
    ec841aab
traps.c 24.5 KB