InnerLoopVectorizer vectorizes loops which contain only one basic block to a specified vectorization factor (VF). More...

Inheritance diagram for llvm::InnerLoopVectorizer:

Public Member Functions
	InnerLoopVectorizer (Loop OrigLoop, PredicatedScalarEvolution &PSE, LoopInfo LI, DominatorTree DT, const TargetTransformInfo TTI, AssumptionCache AC, ElementCount VecWidth, unsigned UnrollFactor, LoopVectorizationCostModel CM, BlockFrequencyInfo BFI, ProfileSummaryInfo PSI, GeneratedRTChecks &RTChecks, VPlan &Plan)

virtual	~InnerLoopVectorizer ()=default

virtual BasicBlock *	createVectorizedLoopSkeleton ()
	Creates a basic block for the scalar preheader.

void	fixVectorizedLoop (VPTransformState &State)
	Fix the vectorized code, taking care of header phi's, and more.

void	fixNonInductionPHIs (VPTransformState &State)
	Fix the non-induction PHIs in `Plan`.

Value *	getTripCount () const
	Returns the original loop trip count.

void	setTripCount (Value *TC)
	Used to set the trip count after ILV's construction and after the preheader block has been executed.

Protected Member Functions
BasicBlock *	createScalarPreheader (StringRef Prefix)
	Create and return a new IR basic block for the scalar preheader whose name is prefixed with `Prefix`.

virtual void	printDebugTracesAtStart ()
	Allow subclasses to override and print debug traces before/after vplan execution, when trace information is requested.

virtual void	printDebugTracesAtEnd ()

Protected Attributes
Loop *	OrigLoop
	The original loop.

PredicatedScalarEvolution &	PSE
	A wrapper around ScalarEvolution used to add runtime SCEV checks.

LoopInfo *	LI
	Loop Info.

DominatorTree *	DT
	Dominator Tree.

const TargetTransformInfo *	TTI
	Target Transform Info.

AssumptionCache *	AC
	Assumption Cache.

ElementCount	VF
	The vectorization SIMD factor to use.

unsigned	UF
	The vectorization unroll factor to use.

IRBuilder	Builder
	The builder that we use.

BasicBlock *	LoopVectorPreHeader = nullptr
	The vector-loop preheader.

Value *	TripCount = nullptr
	Trip count of the original loop.

LoopVectorizationCostModel *	Cost
	The profitablity analysis.

BlockFrequencyInfo *	BFI
	BFI and PSI are used to check for profile guided size optimizations.

ProfileSummaryInfo *	PSI

GeneratedRTChecks &	RTChecks
	Structure to hold information about generated runtime checks, responsible for cleaning the checks, if vectorization turns out unprofitable.

VPlan &	Plan

VPBasicBlock *	VectorPHVPBB
	The vector preheader block of `Plan`, used as target for check blocks introduced during skeleton creation.

Detailed Description

InnerLoopVectorizer vectorizes loops which contain only one basic block to a specified vectorization factor (VF).

This class performs the widening of scalars into vectors, or multiple scalars. This class also implements the following features:

It inserts an epilogue loop for handling loops that don't have iteration counts that are known to be a multiple of the vectorization factor.
It handles the code generation for reduction variables.
Scalarization (implementation using scalars) of un-vectorizable instructions. InnerLoopVectorizer does not perform any vectorization-legality checks, and relies on the caller to check for the different legality aspects. The InnerLoopVectorizer relies on the LoopVectorizationLegality class to provide information about the induction and reduction variables that were found to a given vectorization factor.

Definition at line 498 of file LoopVectorize.cpp.

Constructor & Destructor Documentation

llvm::InnerLoopVectorizer::InnerLoopVectorizer	(	Loop *	OrigLoop,
		PredicatedScalarEvolution &	PSE,
		LoopInfo *	LI,
		DominatorTree *	DT,
		const TargetTransformInfo *	TTI,
		AssumptionCache *	AC,
		ElementCount	VecWidth,
		unsigned	UnrollFactor,
		LoopVectorizationCostModel *	CM,
		BlockFrequencyInfo *	BFI,
		ProfileSummaryInfo *	PSI,
		GeneratedRTChecks &	RTChecks,
		VPlan &	Plan
	)

inline

Definition at line 500 of file LoopVectorize.cpp.

virtual llvm::InnerLoopVectorizer::~InnerLoopVectorizer ( )

virtualdefault

BasicBlock * InnerLoopVectorizer::createScalarPreheader ( StringRef Prefix )

protected

Create and return a new IR basic block for the scalar preheader whose name is prefixed with Prefix.

Definition at line 2376 of file LoopVectorize.cpp.

BasicBlock * InnerLoopVectorizer::createVectorizedLoopSkeleton ( )

virtual

Creates a basic block for the scalar preheader.

Both EpilogueVectorizerMainLoop and EpilogueVectorizerEpilogueLoop overwrite the method to create additional blocks and checks needed for epilogue vectorization.

Definition at line 2428 of file LoopVectorize.cpp.