Table of Contents |
---|
DW Picture
Overview - Dimension tables surrounding fact tables
A representation of how DW 1.0 solves the gnarly aspect of reporting on transaction totals and arrears aging information at MFI/Branch/Loan Officer/Center levels on current and historical date ranges is ...
Star Schema Involving fact_loan_repayments
A representation of how reporting on loan repayments at MFI/Branch/Loan Officer/Center levels on current and historical date ranges is generally is solved by DW 1.0 is ...
Metrics Reporting
A representation of how DW 1.0 solves reporting on 'metrics' at MFI/Branch/Loan Officer/Center levels on current and historical date ranges is ...
(put dim hierarchy piccy here)
High level DW table Info
These tables are currently deployed and being road tested during report development on the development reporting sandbox. Access to this box is restricted but for those with access... the database is called mifos_secdep_dwh and early (poorly presented by me) reports are running from sandbox-reporting.mifos.org/pentaho/Home under the solutions directory JPWWIP/DW standard reports.
Info |
---|
Very Simple Dimension Tables used for filtering and grouping |
Table Name | Description | ETL Approach ('type 2' means a change results in a new entry being added) |
|
---|---|---|---|
dim_date | Very typical date dimension table used in star schema for handy date processing e.g. processing by quarter or month or 2nd day of the week. | Copied from what Jos had in his and Roland's book :) but can be added to (by hand or otherwise) to give whatever data categorisation is relevant. |
|
|
|
|
|
dim_account_action | Just a list of account actions that appear on mifos account_trxn table. | Very simple. Just copied from mifos values. No need to manage 'type 2' changes. |
|
dim_currency | list of currencies. Currency doesn't feature much in current reports but probably will. | Very simple. Just copied from mifos values. No need to manage 'type 2' changes. |
|
dim_product | Just a list of products from mifos table prd_offering with a couple of extra columns to cater for savings product specifics. | Very simple. Just copied from mifos values. No need to manage 'type 2' changes. |
|
Info |
---|
Pretty Simple Dimension Tables used for filtering and grouping |
Table Name | Description | ETL Approach |
|
---|---|---|---|
dim_office | Just a list of offices from the mifos table office. Does include the search_id column that does the 'hierarchy' magic... to help with hierarchy processing in reports (i.e. easy to pick up all branches under a head office. | The was one I wanted to capture movement of, for example, branches to other regional offices. However, that change is not record in mifos. So, for now, this is treated as a simple copy of current information. |
|
|
|
|
|
dim_personnel | Just a list of MFI people from the mifos table personnel. Most relevant because it holds the loan officers... didn't call it dim_loan_officer because wanted to take all MFI people especially as people can 'turn into' and 'out of' loan officers over time. | Apply 'type 2' when loan officers move branch. This means we keep a history of where the loan officer has worked. |
|
Info |
---|
Core Dimension Tables |
Table Name | Description | ETL Approach |
|
---|---|---|---|
dim_customer | Very key dimension table which holds center, group and client details | Apply 'type 2' on hierarchy and status changes. The ETL for this is explained elsewhere but is probably the only 'difficult' bit of the ETL. |
|
dim_loan | Very key dimension table for loans. | Apply 'type 2' on hierarchy and status changes. The ETL for this is explained elsewhere but is probably the only 'difficult' bit of the ETL. |
|
dim_savings | Very key dimension table for savings. | Apply 'type 2' on hierarchy and status changes. The ETL for this is explained elsewhere but is probably the only 'difficult' bit of the ETL. |
|
Info |
---|
The transaction 'fact' Tables |
Table Name | Description | ETL Approach |
|
---|---|---|---|
fact_savings_transactions | Key transaction table holding details of savings deposits, withdrawals and interest payments (also adjustments for deposits and withdrawals) | Transactions simply extracted from mifos table account_trxn and the correct dimension entries applied. |
|
fact_loan_repayments | Key transaction table holding details of loan repayments (and reversals), write-offs, reschedules | Transactions simply extracted from mifos table account_trxn and the correct dimension entries applied. |
|
fact_loan_disbursals | Useful transaction table holding disbursal transactions (and reversals) | Transactions simply extracted from mifos table account_trxn and the correct dimension entries applied. |
|
fact_client_attendances | Simple transaction table hold client meeting attendance info. Not used as much as other fact tables but can report on attendance, absenteeism etc. by all levels. | Transactions simply extracted from mifos equivalent and the correct dimension entries applied. Can be updated. |
|
Info |
---|
Arrears Aging/Provisioning Tables |
Table Name | Description | ETL Approach |
|
---|---|---|---|
hist_loan_arrears | Snapshot table which contains loan arrears information on a particular date. Has been difficult and expensive to report on | Scheduled as necessary (expected daily) and derived from data already in DW database. |
|
dim_arrears_band_monthly | Convenience table. A pre-done monthly banding for arrears aging. Can be edited to meet specific customer needs. | DW Static data (but can be altered). ETL job uses the data |
|
dim_arrears_band_weekly | Convenience table. A pre-done weekly banding for arrears aging. Can be edited to meet specific customer needs. | DW Static data (but can be altered). ETL job uses the data |
|
Info |
---|
Intermediate Staging Tables (not for reporting from) |
Table Name | Description | ETL Approach |
|
---|---|---|---|
stg_customer_and_account_updates | Staging table - into which are put all new customers and account and all changes | Loaded from empty when ETL Run |
|
stg_personnel_names_and_name_changes | Staging table - when a center, group or client changes loan officer... the old and new loan officer | Loaded from empty when ETL Run |
|
Info |
---|
Other |
Table Name | Description | ETL Approach |
|
---|---|---|---|
dw_mfi_configuration | currently contains: | Loaded from prd_type mifos table |
|
dw_loan_schedules | loan schedule details (was a 'fact' table but decided against that as found it very hard to keep schedule entries tracked to the dim_loan entries. | Transactions simply extracted from mifos equivalent. Only links to the loan_account_id not a specific entry in dim_loan. Need to be updated if the schedule dates change (if disbursed on a date different to the expected date). |
|
Info |
---|
Fees haven't been incorporated into this DW yet because we haven't got to them |