Releases: inex/IXP-Manager
Did someone say version 4 is officially released? Yes they did!
It is with great pleasure that we announce the official release v4 of IXP Manager (officially v.4.5.0) (and finally get this monkey off our back!).
INEX has been running v4 in production for over 12 months now. We have also tested the upgrade process with thanks to SwissIX and BCIX - who are both also running it in production. Through those processes we have written up some detailed upgrade instructions which can be found at:
This page covers all the deprecations from IXP Manager v3. It is advised to read those instructions in detail and set aside the best part of a day to work through the process.
If you haven't already seen them, IXP Manager has:
- a new website at: https://www.ixpmanager.org/
- new documentation for v4 at: http://docs.ixpmanager.org/
We have made a massive effort on the new documentation and we are adding to it on a near daily basis.
As well as a new framework, some of the new features in IXP Manager v4 include:
- a brand new framework for router configurations;
- Patch panel/cross connect management;
- new API endpoints;
- Grapher - a completely new graphing backend and management system;
- new implementation of the IX-F Member Export;
- Layer2 address management;
- New looking glass feature with integration with our own Birdseye;
- a new templating engine meaning updates to skinning;
- new frameworks for DNS ARPA exports and Smokeping.
There's also a myriad of other fixes, enhancements and minor features.
Thanks to our sponsors, we now have a full time developer on board so stay tuned for lots more!
If you need help, please contact us via the public mailing list (commercial support is also available). If the upgrade instructions are insufficient, we would also love pull requests to improve the documentation.
Maintenance / bug fix / copyright change release
The main purpose of this release is house keeping and to cap off the v3 branch of IXP Manager in preparation for v4.
This release also contains an administrative name change for the copyright holder. The full details can be read here but the tl;dr version is:
The copyright statement for IXP Manager was changed on 2016-09-23 to reflect the fact that INEX
changed its formal legal name from "Internet Neutral Exchange Association Limited" to "Internet Neutral
Exchange Association Company Limited By Guarantee", as required by the Companies Act 2014.
- Add note about the reason for the company name change (68418dc - Nick Hilliard - 2016-09-23)
- Change name to "Internet Neutral Exchange Association Company Limited By Guarantee" (8d9a6f2 - Nick Hilliard - 2016-09-23)
- Change name to "Internet Neutral Exchange Association Company Limited By Guarantee" (435b65e - Nick Hilliard - 2016-09-23)
- Removed extraneous copyright statement (46e6c96 - Nick Hilliard - 2016-09-23)
- Fix MAU issue on Arista switches (6d08b49 - Barry O'Donovan - 2016-05-31)
- Fix 'Call to a member function debug() on boolean' error (00a8948 - Barry O'Donovan - 2016-09-05)
Bug fix / improvement
This release fixes some minor bugs and updates the foreign reference to OSS_SNMP to support additional switch platforms.
Commits
- Update FK to latest OSS_SNMP (9039dd3 - Barry O'Donovan - 2016-01-27)
- [BF] min != greater or equal. Doh! Prevented port 1 from being selected (ce236cf - Barry O'Donovan - 2016-01-22)
- [BF] oops, BillingAddress3 was omitted in two locations (0e061c0 - Nick Hilliard - 2015-12-03)
- Remove changed: attributes from RIPE objects to close #233 (a75e1fc - Barry O'Donovan - 2015-09-14)
- [BF] Do not show resold customers who have left - fixes #231 (4af0d76 - Barry O'Donovan - 2015-08-22)
- [BF] Fix #207 - "Undefined index: sid" message while trying to view switch ports via SNMP (7eb2dc7 - Barry O'Donovan - 2015-06-30)
- Update FK to OSS_SNMP (0a93a2a - Barry O'Donovan - 2015-06-30)
Templates Updated
application/modules/apiv1/views/rir/tmpl/as-set-ixp-connected.tpl
application/modules/apiv1/views/rir/tmpl/as-set-ixp-rs-v4.tpl
application/modules/apiv1/views/rir/tmpl/as-set-ixp-rs-v6.tpl
application/modules/apiv1/views/rir/tmpl/as-set-ixp-rs.tpl
application/modules/apiv1/views/rir/tmpl/autnum.tpl
application/views/customer/overview-tabs/details.phtml
application/views/customer/overview-tabs/resold-customers.phtml
application/views/switch-port/list-toolbar.phtml
Improvements / Bug Fixes / Housekeeping
This release merges a number of outstanding pull requests and closing ~20+ issues.
Besides @barryo and @nickhilliard , additional contributors to this release include @will-h, @fooelisa, @rowanthorpe (as well as issues and feedback from @bcix and others). Thanks!
Post Upgrade Tasks
Assuming you're located in the base directory of IXP Manager:
-
Refresh your SQL views:
mysql -u username -ppassword [dbname] < tools/sql/views.sql
-
Rescan your switches:
./bin/ixptool.php -a switch-cli.snmp-poll
Views Changed Since v3.7.2
application/views/_skins/inex/customer/email/welcome-email.phtml
application/views/_skins/inex/static/support.phtml
application/views/_skins/inex/statistics-cli/mrtg/trunks.cfg
application/views/admin/index.phtml
application/views/customer/detail.phtml
application/views/customer/forms/edit.phtml
application/views/customer/overview-tabs/overview.phtml
application/views/customer/overview-tabs/ports.phtml
application/views/customer/overview-tabs/ports/physintstatus.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/ipv4-address/js/list.js
application/views/peering-manager/peering-request-message.phtml
application/views/peering-matrix/index.phtml
application/views/router-cli/server/bird/neighbor.cfg
application/views/rs-prefixes/list-help.phtml
application/views/statistics-cli/mrtg/member-port.cfg
application/views/virtual-interface/add-postamble.phtml
application/views/virtual-interface/forms/add-wizard.phtml
application/views/virtual-interface/js/add-wizard.js
application/views/vlan-interface/forms/vlan-interface.phtml
Commits
- Fix #171 - Discards not graphed on Extreme XOS platforms (f21f95a - Barry O'Donovan - 2015-06-29)
- Fix #166 - statistics-cli.upload-traffic-stats-to-db timeouts when new customer does not have ports (2b664ce - Barry O'Donovan - 2015-06-29)
- Proof of concept to close #21 (e562185 - Barry O'Donovan - 2015-06-29)
- Fix #168 - vlan-interface/edit doesn't sanitise ipvXhostname correctly (114e612 - Barry O'Donovan - 2015-06-29)
- Merge pull request #208 from will-h/master (a259286 - Barry O'Donovan - 2015-06-29)
- Fix #212 - peeringmacrov6 cannot be updated via the UI (d059073 - Barry O'Donovan - 2015-06-29)
- [HK] Close #193 (0630aab - Barry O'Donovan - 2015-06-29)
- Fix #194 - JS md5 password autogenerator (c1affe0 - Barry O'Donovan - 2015-06-29)
- Fix #201 again without white space changes (b33782e - Barry O'Donovan - 2015-06-29)
- Revert "Fix #201 - empty ASN list causes bird RS config to bomb" (1af8fb6 - Barry O'Donovan - 2015-06-29)
- Fix #191 - Can select errors graph type in peer to peer statistics (00a631f - Barry O'Donovan - 2015-06-29)
- Fix #201 - empty ASN list causes bird RS config to bomb (5c99b4d - Barry O'Donovan - 2015-06-29)
- Fix #206 - PHP warnings about undefined variable url (21cce54 - Barry O'Donovan - 2015-06-29)
- [BF] addition fixes for #222 and #217 (7791a8b - Barry O'Donovan - 2015-06-29)
- Merge branch 'rowanthorpe-add-as112-active-config-var' (56bef0f - Barry O'Donovan - 2015-06-29)
- Defaulting to true to maintain backwards compatibility (0789156 - Barry O'Donovan - 2015-06-29)
- Merge branch 'add-as112-active-config-var' of git://github.com/rowanthorpe/IXP-Manager into rowanthorpe-add-as112-active-config-var (ad6cf91 - Barry O'Donovan - 2015-06-29)
- [BF] Fix #222 - Port status displayed incorrectly for LAGs (14497bf - Barry O'Donovan - 2015-06-29)
- Add config-var to make as112 optional in UI (Fixes #217) (5ff31e2 - Rowan Thorpe - 2015-06-18)
- Fix #218 (8772169 - Barry O'Donovan - 2015-06-18)
- Do not escape unicode or escape forward slashes - fixes #216 (033d533 - Nick Hilliard - 2015-06-18)
- Merge pull request #214 from rowanthorpe/add-encoding-to-zend-string-validate (ebaf4cf - Barry O'Donovan - 2015-06-18)
- Do not escape unicode or escape forward slashes - fixes #216 (5c53981 - Barry O'Donovan - 2015-06-18)
- Ensure string-validate uses UTF-8, not system-default (7a07a55 - Rowan Thorpe - 2015-06-17)
- Merge pull request #211 from rowanthorpe/prefix-analysis-tool-tweaks (8d5b472 - Nick Hilliard - 2015-05-29)
- Loosen list-matching regex for whitespace in bird config (8aca25f - Rowan Thorpe - 2015-05-29)
- Mute starting and ending SQL transaction if $do_nothing (04f3742 - Rowan Thorpe - 2015-05-29)
- [BF] peering matrix depends on sflow, not netflow (893cd7a - Nick Hilliard - 2015-05-23)
- Update FK to OSS_SNMP and close #210 (6233575 - Barry O'Donovan - 2015-05-19)
- Address issue #209 - secure by default (f2889a4 - Barry O'Donovan - 2015-05-07)
- Add Connected Capacity totals to admin interface (a2ba79d - will-h - 2015-04-29)
- [BF] Send peering requests as UTF-8 (525cc66 - Barry O'Donovan - 2015-03-30)
- [BF] Fix #202 for multiple VLAN interfaces on the same peering LAN (1832db3 - Barry O'Donovan - 2015-03-30)
- [BF] Fix #202 - md5s for different lans (c71a0d4 - Barry O'Donovan - 2015-03-23)
- [IM] Some switches support MAU but not all of the MIBs (57729a7 - Barry O'Donovan - 2015-03-11)
- [BF] Reset counter for each virtual interface - fixes #192 (e20f677 - Barry O'Donovan - 2015-03-02)
- [BF] Do not show ip addresses if disabled (a57dbc0 - Barry O'Donovan - 2015-02-20)
- Fixes #200 - checking on an undefined snmpid, do not include those into the mrtg conf (3674006 - Barry O'Donovan - 2015-02-18)
- adding belts and all, barryo is going to like this (9660b16 - Elisa Jasinska - 2015-02-11)
- importing LAG MAC addresses which are behind a logical interface by saving the virtual interface name in the DB and matching on those (83dfba1 - Elisa Jasinska - 2015-02-11)
Implement use of the IANA MAU MIB for Discovering Port Media
This update implements the IANA MAU MIB as requested in #130. The features added include:
- use of MAU MIB when polling switches via the routine cron job
- new switch port views for those that support the MAU MIB (click Switches in the admin interface and then select View Port MAU Detail (database only) from the switch row's dropdown);
- a new view of unused optics (click Switches in the admin interface and then Unused Optics);
- the port medium type is now shown in all port details pages.
Schema Updates Required
ALTER TABLE switch
ADD mauSupported TINYINT(1) DEFAULT NULL;
ALTER TABLE switchport
ADD mauType VARCHAR(255) DEFAULT NULL,
ADD mauState VARCHAR(255) DEFAULT NULL,
ADD mauAvailability VARCHAR(255) DEFAULT NULL,
ADD mauJacktype VARCHAR(255) DEFAULT NULL,
ADD mauAutoNegSupported TINYINT(1) DEFAULT NULL,
ADD mauAutoNegAdminState TINYINT(1) DEFAULT NULL;
Also In This Release
- Following a mailing list discussion,
tools/perl-lib/IXPManager/ixpmanager.conf
has been renamed totools/perl-lib/IXPManager/ixpmanager.conf.dist
to prevent overwrites for people who use it in place. - [IM] Added 40G and 100G speed options for physical interfaces (Elisa Jasinska - 2015-01-16)
- [IM] Updated mrtg trunks.cfg (995fd3c - Nick Hilliard - 2015-01-16)
- [IM] Changed execute bit on perl dependency test script (ebd8158 - Elisa Jasinska - 2015-01-12)
- [IM] Fix typos in the rs-config-all example script (c60d4b7 - Rowan Thorpe - 2014-12-16)
- [IM] Only display a message if we are filtering and then display the appropriate message(s) (54950b7 - Barry O'Donovan - 2014-12-15)
- [BF] Path fix (a8692c4 - Barry O'Donovan - 2014-12-15)
- [CI] New known-good bird configs for deterministic ordering (d983b91 - Barry O'Donovan - 2014-12-15)
- [IM] Also ensure deterministic ordering of acls for route server configs (9cec6bd - Barry O'Donovan - 2014-12-15)
- [IM] Ensure deterministic ordering for same ASNs (1183685 - Barry O'Donovan - 2014-12-15)
- [IM] Added bgp max prefixes to CUSTUSER Member Details view page (389cc30 - Nick Hilliard - 2014-12-14)
- [BF] #190: sflow-to-rrd-handler passes extra argument to rrd update (81a7fa8 - Nick Hilliard - 2014-12-13)
- [BF] perl 5.20 deprecates when/given (53720c2 - Nick Hilliard - 2014-12-13)
- [BF] Limit recent members to 3, not all (479a21a - Barry O'Donovan - 2014-12-12)
- [CI] Update database schema used by CI tests (e27e44c - Barry O'Donovan - 2014-12-08)
- [BF] Ensure we have physical interfaces before using them - fixes #187 (a5abbcb - Barry O'Donovan - 2014-12-04)
- [BF] Fix regression - fixes #186 (2d56b97 - Barry O'Donovan - 2014-12-04)
- [IM] Discourage manaual addition of switches (70643c0 - Barry O'Donovan - 2014-12-04)
- [IM] Remove confusing link to non-SNMP switch add method (58ac575 - Barry O'Donovan - 2014-12-04)
- [BF] fix perl 5.18 hash key randomisation issue (edf6d10 - Nick Hilliard - 2014-11-30)
- [HK] Renamed to prevent overwrites for people who use it in place. (6aad7a2 - Barry O'Donovan - 2014-11-29)
Views / Templates Changed
application/views/_skins/example/public/member-details.phtml
application/views/_skins/example/public/member-details/json.phtml
application/views/customer/detail.phtml
application/views/customer/overview-tabs/ports/physintstatus.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/dashboard/index-tabs/associate.phtml
application/views/menu.phtml
application/views/switch-port/list-column-port-admin-oper-status.phtml
application/views/switch-port/list-mau.phtml
application/views/switch-port/list-toolbar.phtml
application/views/switch-port/unused-optics.phtml
application/views/switch/add-preamble.phtml
application/views/switch/add-toolbar.phtml
application/views/switch/list-row-menu.phtml
Bug fix / improvement
This release fixes a regression introduced in a third party library as part of the recent security fix (v3.6.19). This bug will prevent users from resetting and changing passwords.
Additionally, this release closes #180 by de-INEX-ifying the peering manager. Please see updated documentation at: https://github.com/inex/IXP-Manager/wiki/Peering-Manager
Commits
- [IM] de-inexify peering manager - fixes #180 (272648b - Barry O'Donovan - 2014-11-27)
- [BF] Auth issue for password resets (0070874 - Barry O'Donovan - 2014-11-27)
Templates Updated
application/views/peering-manager/peering-request-message.phtml
New Features / Improvements / Bug Fixes / Housekeeping
This release is very much driven by recent mailing list activity.
NB: This upgrade requires a schema change - see below.
Primarily, scripts have been added to power the peering matrices and peering manager. These scripts parse sflow data and discover established BGP sessions between exchange members. See the following updated and new documentation:
- https://github.com/inex/IXP-Manager/wiki/Installing-Sflow-Support
- https://github.com/inex/IXP-Manager/wiki/Sflowtool-fan-out
- https://github.com/inex/IXP-Manager/wiki/Peering-Matrix
- https://github.com/inex/IXP-Manager/wiki/Peering-Manager
Front end options have been added when adding / editing VLANs to allow you to state whether a given VLAN should be including in the peering matrix page and/or the peering manager. Post upgrade, you need to check these fields for the VLANs you want included.
Schema Change Required
ALTER TABLE vlan
ADD peering_matrix TINYINT(1) NOT NULL DEFAULT 0,
ADD peering_manager TINYINT(1) NOT NULL DEFAULT 0;
NB: After running the above, edit your VLANs and check peering manager and / or peering matrix as appropriate for VLANs you want included in the peering manager / matrix.
Commits
- [IM] Remove hardcoded INEX VLAN details for peering matrices (16f6411 - Barry O'Donovan - 2014-11-26)
- [IM] Remove hardcoded INEX VLAN details - fixes #178 (87edf85 - Barry O'Donovan - 2014-11-26)
- [NF] Front end glue for new VLAN peering matrix / manager columns (edfefcf - Barry O'Donovan - 2014-11-26)
- [DB] Schema update to VLANs table (5c48610 - Barry O'Donovan - 2014-11-26)
- [BF] Fixes #177 - only one switch per infra was included in EuroIX data output (41cc73c - Barry O'Donovan - 2014-11-25)
- [HK] Remove extraneous files (1518e92 - Barry O'Donovan - 2014-11-24)
- [IM] Reduce cache time pf peering data from 1 day to 1 hour (4db3001 - Barry O'Donovan - 2014-11-24)
- [BF] bugfixes for Daemon::Control (538a306 - Nick Hilliard - 2014-11-23)
- [IM] add script to check for required perl dependencies (f0609e3 - Nick Hilliard - 2014-11-22)
- [IM] wider use of variable names for code which is fundamentally the same (f8f726c - Nick Hilliard - 2014-11-22)
- [BF] use different local variable names and protect with 'my' (daf5406 - Nick Hilliard - 2014-11-22)
- [IM] added peering manager sflow bgp session detector (9942ffa - Nick Hilliard - 2014-11-22)
- [IM] cosmetic fixes for sflow-to-rrd-handler (b8b2035 - Nick Hilliard - 2014-11-22)
- [IM] updated trunks.cfg to reflect topology changes (a39b495 - Nick Hilliard - 2014-11-21)
- HK ORG-INEX1-RIPE -> ORG-INEA1-RIPE (af93c94 - Nick Hilliard - 2014-11-21)
- [IM] compare-route-server-prefixes.pl should do something instead of do_nothing (85bfc98 - Nick Hilliard - 2014-11-18)
- [BF] update route server comparison code to reflect changes in default bird config (8ca7ddc - Nick Hilliard - 2014-11-18)
- [BF] added new-line for prefix comparison tool warnings (5528b5d - Nick Hilliard - 2014-11-18)
- [HK] typos (1644ec3 - Nick Hilliard - 2014-11-17)
Templates Edited
application/modules/apiv1/views/_skins/inex/rir/tmpl/autnum-as2128.tpl
application/views/_skins/inex/statistics-cli/mrtg/trunks.cfg
application/views/peering-manager/index-table.phtml
application/views/peering-matrix/index.phtml
application/views/vlan/add-postamble.phtml
Security Release
IXP Manager v3.6.19 is now available as a security release for all previous versions. We strongly encourage you to update your sites immediately.
This release fixes a possible (already authenticated) user privilege escalation via a stored XSS vulnerability and cookie robbery.
All vulnerabilities were found and responsibly reported by Alexandros Zaharis, Security Officer at GRNET to whom we are very grateful.
IXP Manager v3.6.19 also contains other security changes:
- Reflective XSS vulnerability for non-authenticated users.
- Disabling a user account did not prevent them from logging in.
In addition to the security fixes, there is also a new feature: addition of the euro-ix BCP data export format for IX members as introduced by Elisa Jasinska and Nick Hilliard at RIPE 69 (presentation and video).
Views changed since v3.6.16:
application/views/customer/overview-tabs/overview.phtml
application/views/header-css.phtml
application/views/header-js.phtml
Maintenance and bug fix release
Minor improvements including addition of support for HP ProCurve 2824 switches.
Commits
- [NF] Add HP as a vendor (b8d5628 - Barry O'Donovan - 2014-10-21)
- [BF] Make IRRDB form field wider (0c58917 - Barry O'Donovan - 2014-10-21)
- [NF] Update reference to OSS_SNMP (a3c0513 - Barry O'Donovan - 2014-10-21)
- [HK] typo (8a6f5f4 - Nick Hilliard - 2014-10-10)
- [BF] UI tweak for irrdb config (cd29e44 - Nick Hilliard - 2014-09-30)
- [BF] JS Throbber issue - fixes #165 (bb4c11d - Barry O'Donovan - 2014-09-29)
- [BF] Bug introduced regarding uniqueness of monitor index (d43efea - Barry O'Donovan - 2014-09-03)
- [IM] Hide customer details not relevent for associate members (3011e56 - Barry O'Donovan - 2014-08-25)
Templates
The following view files were updated / added:
application/views/customer/overview-tabs/overview.phtml
application/views/header-css.phtml
application/views/header-js.phtml
Maintenance and bug fix release
This release closes a number of issues reported on GitHub.
In particular, something that bites now and again is when a customer or port does not have status NORMAL
. This means a lot of auto-conf'd stuff is skipped (MRTG, Nagios, etc.). This release includes commits that will highlight:
- a not normal customer in the overview title
- a not normal customer is the ports overview tab
- a not normal port is the port details (clickable to directly edit)
Commits
- [IM] Enlarge fields - especially chosen dropdowns (209a7b7 - Barry O'Donovan - 2014-08-24)
- [IM] Skip switches with no SNMP password in CLI SNMP poller - closes #145 (d202c38 - Barry O'Donovan - 2014-08-24)
- [IM] Allow IP addresses to be removed from disabled interfaces (c427348 - Barry O'Donovan - 2014-08-24)
- [IM] Enforce unique monitor indexes - closes #156 (9980cfe - Barry O'Donovan - 2014-08-24)
- [BF] Require an infrastructure when adding / editing a VLAN - closes #160 (78735c5 - Barry O'Donovan - 2014-08-24)
- [IM] Show message when some / all of a member's ports have no IRRDB filtering enabled - closes #161 (bd2cf37 - Barry O'Donovan - 2014-08-24)
- [IM] Do not hardcode configuration name - closes #162 (be98af5 - Barry O'Donovan - 2014-08-24)
- [IM] Sort Smokeping by name - closes #163 (0db5163 - Barry O'Donovan - 2014-08-24)
- [NF] Do not set MD5 secret by default as requested in #164 (affcc02 - Barry O'Donovan - 2014-08-24)
- [IM] Better indication of ports not in state normal (41a093b - Barry O'Donovan - 2014-08-24)
- [IM] Better indication of ports not in state normal (85e8115 - Barry O'Donovan - 2014-08-24)
- [IM] Better indication of trafficing customers are not in normal status (1c76492 - Barry O'Donovan - 2014-08-24)
Templates
The following view files were updated / added:
application/views/customer/custtype.phtml
application/views/customer/overview-tabs/ports.phtml
application/views/customer/overview-tabs/ports/physintstatus.phtml
application/views/customer/overview-tabs/ports/port.phtml
application/views/rs-prefixes/list.phtml
application/views/smokeping-cli/conf/targets.cfg
application/views/virtual-interface/js/add-wizard.js